2023-02-10 07:53:33,323 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-10 07:53:33,595 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d 2023-02-10 07:53:33,611 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-10 07:53:33,612 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/cluster_ca906608-436c-7df5-28a0-58c9b32cd1e1, deleteOnExit=true 2023-02-10 07:53:33,612 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-10 07:53:33,613 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/test.cache.data in system properties and HBase conf 2023-02-10 07:53:33,613 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/hadoop.tmp.dir in system properties and HBase conf 2023-02-10 07:53:33,614 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/hadoop.log.dir in system properties and HBase conf 2023-02-10 07:53:33,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-10 07:53:33,615 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-10 07:53:33,615 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-10 07:53:33,732 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-10 07:53:34,131 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-10 07:53:34,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-10 07:53:34,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-10 07:53:34,138 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-10 07:53:34,138 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 07:53:34,138 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-10 07:53:34,139 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-10 07:53:34,139 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-10 07:53:34,140 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 07:53:34,140 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-10 07:53:34,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/nfs.dump.dir in system properties and HBase conf 2023-02-10 07:53:34,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/java.io.tmpdir in system properties and HBase conf 2023-02-10 07:53:34,141 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-10 07:53:34,142 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-10 07:53:34,142 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-10 07:53:34,695 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 07:53:34,701 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 07:53:35,007 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-10 07:53:35,188 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-10 07:53:35,214 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 07:53:35,253 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 07:53:35,286 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/java.io.tmpdir/Jetty_localhost_42169_hdfs____ep9540/webapp 2023-02-10 07:53:35,421 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42169 2023-02-10 07:53:35,461 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-10 07:53:35,462 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-10 07:53:35,887 WARN [Listener at localhost/39777] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 07:53:36,014 WARN [Listener at localhost/39777] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-10 07:53:36,031 WARN [Listener at localhost/39777] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-10 07:53:36,038 INFO [Listener at localhost/39777] log.Slf4jLog(67): jetty-6.1.26 2023-02-10 07:53:36,043 INFO [Listener at localhost/39777] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/java.io.tmpdir/Jetty_localhost_36169_datanode____d96u3c/webapp 2023-02-10 07:53:36,139 INFO [Listener at localhost/39777] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36169 2023-02-10 07:53:36,435 WARN [Listener at localhost/46793] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-10 07:53:36,834 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2cb92c544951e7ff: Processing first storage report for DS-96fb93ed-3ce2-40cd-962c-858ae93eaffb from datanode bfc92a38-a2a1-470c-a604-f4f6b4dea777 2023-02-10 07:53:36,835 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2cb92c544951e7ff: from storage DS-96fb93ed-3ce2-40cd-962c-858ae93eaffb node DatanodeRegistration(127.0.0.1:33739, datanodeUuid=bfc92a38-a2a1-470c-a604-f4f6b4dea777, infoPort=41937, infoSecurePort=0, ipcPort=46793, storageInfo=lv=-57;cid=testClusterID;nsid=1783184846;c=1676015614786), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-10 07:53:36,836 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2cb92c544951e7ff: Processing first storage report for DS-a3e7fa6d-3d78-4d36-bb64-aa2d6426bc79 from datanode bfc92a38-a2a1-470c-a604-f4f6b4dea777 2023-02-10 07:53:36,836 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2cb92c544951e7ff: from storage DS-a3e7fa6d-3d78-4d36-bb64-aa2d6426bc79 node DatanodeRegistration(127.0.0.1:33739, datanodeUuid=bfc92a38-a2a1-470c-a604-f4f6b4dea777, infoPort=41937, infoSecurePort=0, ipcPort=46793, storageInfo=lv=-57;cid=testClusterID;nsid=1783184846;c=1676015614786), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-10 07:53:36,917 DEBUG [Listener at localhost/46793] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d 2023-02-10 07:53:36,976 INFO [Listener at localhost/46793] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/cluster_ca906608-436c-7df5-28a0-58c9b32cd1e1/zookeeper_0, clientPort=54857, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/cluster_ca906608-436c-7df5-28a0-58c9b32cd1e1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/cluster_ca906608-436c-7df5-28a0-58c9b32cd1e1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-10 07:53:36,989 INFO [Listener at localhost/46793] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54857 2023-02-10 07:53:36,997 INFO [Listener at localhost/46793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:53:37,000 INFO [Listener at localhost/46793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:53:37,641 INFO [Listener at localhost/46793] util.FSUtils(479): Created version file at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217 with version=8 2023-02-10 07:53:37,642 INFO [Listener at localhost/46793] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/hbase-staging 2023-02-10 07:53:37,938 INFO [Listener at localhost/46793] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-10 07:53:38,389 INFO [Listener at localhost/46793] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-02-10 07:53:38,421 INFO [Listener at localhost/46793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 07:53:38,421 INFO [Listener at localhost/46793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 07:53:38,422 INFO [Listener at localhost/46793] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 07:53:38,422 INFO [Listener at localhost/46793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 07:53:38,422 INFO [Listener at localhost/46793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 07:53:38,565 INFO [Listener at localhost/46793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 07:53:38,635 DEBUG [Listener at localhost/46793] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-10 07:53:38,726 INFO [Listener at localhost/46793] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42691 2023-02-10 07:53:38,736 INFO [Listener at localhost/46793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:53:38,738 INFO [Listener at localhost/46793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:53:38,757 INFO [Listener at localhost/46793] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42691 connecting to ZooKeeper ensemble=127.0.0.1:54857 2023-02-10 07:53:38,797 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:426910x0, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 07:53:38,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42691-0x1003d38ad880000 connected 2023-02-10 07:53:38,827 DEBUG [Listener at localhost/46793] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 07:53:38,827 DEBUG [Listener at localhost/46793] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 07:53:38,830 DEBUG [Listener at localhost/46793] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 07:53:38,838 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42691 2023-02-10 07:53:38,838 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42691 2023-02-10 07:53:38,838 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42691 2023-02-10 07:53:38,839 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42691 2023-02-10 07:53:38,839 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42691 2023-02-10 07:53:38,845 INFO [Listener at localhost/46793] master.HMaster(439): hbase.rootdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217, hbase.cluster.distributed=false 2023-02-10 07:53:38,910 INFO [Listener at localhost/46793] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-02-10 07:53:38,910 INFO [Listener at localhost/46793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 07:53:38,910 INFO [Listener at localhost/46793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-10 07:53:38,911 INFO [Listener at localhost/46793] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-10 07:53:38,911 INFO [Listener at localhost/46793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-10 07:53:38,911 INFO [Listener at localhost/46793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-10 07:53:38,916 INFO [Listener at localhost/46793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-10 07:53:38,918 INFO [Listener at localhost/46793] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36907 2023-02-10 07:53:38,921 INFO [Listener at localhost/46793] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-10 07:53:38,926 DEBUG [Listener at localhost/46793] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-10 07:53:38,927 INFO [Listener at localhost/46793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:53:38,930 INFO [Listener at localhost/46793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:53:38,931 INFO [Listener at localhost/46793] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36907 connecting to ZooKeeper ensemble=127.0.0.1:54857 2023-02-10 07:53:38,936 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:369070x0, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-10 07:53:38,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36907-0x1003d38ad880001 connected 2023-02-10 07:53:38,938 DEBUG [Listener at localhost/46793] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 07:53:38,939 DEBUG [Listener at localhost/46793] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 07:53:38,940 DEBUG [Listener at localhost/46793] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-10 07:53:38,940 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36907 2023-02-10 07:53:38,941 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36907 2023-02-10 07:53:38,941 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36907 2023-02-10 07:53:38,941 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36907 2023-02-10 07:53:38,942 DEBUG [Listener at localhost/46793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36907 2023-02-10 07:53:38,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:53:38,952 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 07:53:38,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:53:38,970 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 07:53:38,970 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-10 07:53:38,970 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:53:38,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 07:53:38,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42691,1676015617779 from backup master directory 2023-02-10 07:53:38,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-10 07:53:38,975 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:53:38,975 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-10 07:53:38,976 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 07:53:38,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:53:38,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-10 07:53:38,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-10 07:53:39,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/hbase.id with ID: 62d19a9b-0399-416f-87f4-f7a59d0c89bb 2023-02-10 07:53:39,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:53:39,119 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:53:39,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1c4e0d58 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:53:39,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11fd549a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:53:39,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-10 07:53:39,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-10 07:53:39,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-10 07:53:39,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-10 07:53:39,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-10 07:53:39,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-10 07:53:39,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 07:53:39,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store-tmp 2023-02-10 07:53:39,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:39,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 07:53:39,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 07:53:39,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 07:53:39,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 07:53:39,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 07:53:39,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 07:53:39,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676015619690Disabling compacts and flushes for region at 1676015619690Disabling writes for close at 1676015619690Writing region close event to WAL at 1676015619691 (+1 ms)Closed at 1676015619691 2023-02-10 07:53:39,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/WALs/jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:53:39,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42691%2C1676015617779, suffix=, logDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/WALs/jenkins-hbase4.apache.org,42691,1676015617779, archiveDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/oldWALs, maxLogs=10 2023-02-10 07:53:39,763 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33739,DS-96fb93ed-3ce2-40cd-962c-858ae93eaffb,DISK] 2023-02-10 07:53:39,770 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-10 07:53:39,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/WALs/jenkins-hbase4.apache.org,42691,1676015617779/jenkins-hbase4.apache.org%2C42691%2C1676015617779.1676015619722 2023-02-10 07:53:39,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33739,DS-96fb93ed-3ce2-40cd-962c-858ae93eaffb,DISK]] 2023-02-10 07:53:39,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:53:39,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:39,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 07:53:39,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 07:53:39,888 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-10 07:53:39,895 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-10 07:53:39,918 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-10 07:53:39,932 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:39,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 07:53:39,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-10 07:53:39,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-10 07:53:39,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:53:39,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69655808, jitterRate=0.037952423095703125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:53:39,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676015619860Initializing all the Stores at 1676015619862 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676015619863 (+1 ms)Cleaning up temporary data from old regions at 1676015619947 (+84 ms)Cleaning up detritus from prior splits at 1676015619947Region opened successfully at 1676015619962 (+15 ms) 2023-02-10 07:53:39,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-10 07:53:39,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-10 07:53:39,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-10 07:53:39,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-10 07:53:39,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-10 07:53:40,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-02-10 07:53:40,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-10 07:53:40,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-10 07:53:40,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-10 07:53:40,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-10 07:53:40,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-10 07:53:40,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-10 07:53:40,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-10 07:53:40,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-10 07:53:40,089 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:53:40,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-10 07:53:40,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-10 07:53:40,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-10 07:53:40,107 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 07:53:40,107 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-10 07:53:40,107 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:53:40,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42691,1676015617779, sessionid=0x1003d38ad880000, setting cluster-up flag (Was=false) 2023-02-10 07:53:40,127 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:53:40,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-10 07:53:40,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:53:40,140 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:53:40,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-10 07:53:40,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:53:40,149 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp 2023-02-10 07:53:40,246 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(952): ClusterId : 62d19a9b-0399-416f-87f4-f7a59d0c89bb 2023-02-10 07:53:40,250 DEBUG [RS:0;jenkins-hbase4:36907] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-10 07:53:40,256 DEBUG [RS:0;jenkins-hbase4:36907] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-10 07:53:40,256 DEBUG [RS:0;jenkins-hbase4:36907] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-10 07:53:40,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-10 07:53:40,259 DEBUG [RS:0;jenkins-hbase4:36907] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-10 07:53:40,260 DEBUG [RS:0;jenkins-hbase4:36907] zookeeper.ReadOnlyZKClient(139): Connect 0x62f1e446 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:53:40,266 DEBUG [RS:0;jenkins-hbase4:36907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c360668, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:53:40,266 DEBUG [RS:0;jenkins-hbase4:36907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68098f36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 07:53:40,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 07:53:40,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 07:53:40,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 07:53:40,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-10 07:53:40,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-10 07:53:40,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 07:53:40,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676015650270 2023-02-10 07:53:40,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-10 07:53:40,276 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 07:53:40,276 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-10 07:53:40,282 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 07:53:40,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-10 07:53:40,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-10 07:53:40,292 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36907 2023-02-10 07:53:40,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-10 07:53:40,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-10 07:53:40,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-10 07:53:40,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-10 07:53:40,297 INFO [RS:0;jenkins-hbase4:36907] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-10 07:53:40,297 INFO [RS:0;jenkins-hbase4:36907] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-10 07:53:40,297 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1023): About to register with Master. 2023-02-10 07:53:40,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-10 07:53:40,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-10 07:53:40,300 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42691,1676015617779 with isa=jenkins-hbase4.apache.org/172.31.14.131:36907, startcode=1676015618909 2023-02-10 07:53:40,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-10 07:53:40,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-10 07:53:40,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676015620303,5,FailOnTimeoutGroup] 2023-02-10 07:53:40,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676015620303,5,FailOnTimeoutGroup] 2023-02-10 07:53:40,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,304 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-10 07:53:40,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,319 DEBUG [RS:0;jenkins-hbase4:36907] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-10 07:53:40,365 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52261, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-10 07:53:40,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:40,390 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217 2023-02-10 07:53:40,390 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:39777 2023-02-10 07:53:40,390 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-10 07:53:40,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 07:53:40,396 DEBUG [RS:0;jenkins-hbase4:36907] zookeeper.ZKUtil(162): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:40,396 WARN [RS:0;jenkins-hbase4:36907] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-10 07:53:40,396 INFO [RS:0;jenkins-hbase4:36907] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 07:53:40,397 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1947): logDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/WALs/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:40,398 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36907,1676015618909] 2023-02-10 07:53:40,405 DEBUG [RS:0;jenkins-hbase4:36907] zookeeper.ZKUtil(162): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:40,414 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-10 07:53:40,422 INFO [RS:0;jenkins-hbase4:36907] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-10 07:53:40,441 INFO [RS:0;jenkins-hbase4:36907] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-10 07:53:40,444 INFO [RS:0;jenkins-hbase4:36907] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:53:40,445 INFO [RS:0;jenkins-hbase4:36907] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,445 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-10 07:53:40,452 INFO [RS:0;jenkins-hbase4:36907] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,452 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,453 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,453 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,453 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,453 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,453 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-10 07:53:40,453 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,453 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,453 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,454 DEBUG [RS:0;jenkins-hbase4:36907] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-10 07:53:40,454 INFO [RS:0;jenkins-hbase4:36907] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,454 INFO [RS:0;jenkins-hbase4:36907] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,455 INFO [RS:0;jenkins-hbase4:36907] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,469 INFO [RS:0;jenkins-hbase4:36907] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-10 07:53:40,471 INFO [RS:0;jenkins-hbase4:36907] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36907,1676015618909-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:40,486 INFO [RS:0;jenkins-hbase4:36907] regionserver.Replication(203): jenkins-hbase4.apache.org,36907,1676015618909 started 2023-02-10 07:53:40,486 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36907,1676015618909, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36907, sessionid=0x1003d38ad880001 2023-02-10 07:53:40,487 DEBUG [RS:0;jenkins-hbase4:36907] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-10 07:53:40,487 DEBUG [RS:0;jenkins-hbase4:36907] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:40,487 DEBUG [RS:0;jenkins-hbase4:36907] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36907,1676015618909' 2023-02-10 07:53:40,487 DEBUG [RS:0;jenkins-hbase4:36907] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:40,487 DEBUG [RS:0;jenkins-hbase4:36907] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:40,488 DEBUG [RS:0;jenkins-hbase4:36907] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-10 07:53:40,488 DEBUG [RS:0;jenkins-hbase4:36907] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-10 07:53:40,488 DEBUG [RS:0;jenkins-hbase4:36907] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:40,488 DEBUG [RS:0;jenkins-hbase4:36907] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36907,1676015618909' 2023-02-10 07:53:40,488 DEBUG [RS:0;jenkins-hbase4:36907] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 07:53:40,489 DEBUG [RS:0;jenkins-hbase4:36907] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 07:53:40,489 DEBUG [RS:0;jenkins-hbase4:36907] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-10 07:53:40,489 INFO [RS:0;jenkins-hbase4:36907] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-10 07:53:40,489 INFO [RS:0;jenkins-hbase4:36907] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-10 07:53:40,600 INFO [RS:0;jenkins-hbase4:36907] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36907%2C1676015618909, suffix=, logDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/WALs/jenkins-hbase4.apache.org,36907,1676015618909, archiveDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/oldWALs, maxLogs=32 2023-02-10 07:53:40,618 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33739,DS-96fb93ed-3ce2-40cd-962c-858ae93eaffb,DISK] 2023-02-10 07:53:40,621 INFO [RS:0;jenkins-hbase4:36907] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/WALs/jenkins-hbase4.apache.org,36907,1676015618909/jenkins-hbase4.apache.org%2C36907%2C1676015618909.1676015620602 2023-02-10 07:53:40,622 DEBUG [RS:0;jenkins-hbase4:36907] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33739,DS-96fb93ed-3ce2-40cd-962c-858ae93eaffb,DISK]] 2023-02-10 07:53:40,715 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 07:53:40,716 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-10 07:53:40,716 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217 2023-02-10 07:53:41,129 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:41,132 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 07:53:41,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/info 2023-02-10 07:53:41,135 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 07:53:41,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:41,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 07:53:41,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/rep_barrier 2023-02-10 07:53:41,140 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 07:53:41,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:41,141 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 07:53:41,143 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/table 2023-02-10 07:53:41,143 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 07:53:41,144 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:41,145 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740 2023-02-10 07:53:41,146 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740 2023-02-10 07:53:41,150 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 07:53:41,153 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 07:53:41,156 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:53:41,157 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62533931, jitterRate=-0.06817181408405304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 07:53:41,157 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676015621129Initializing all the Stores at 1676015621131 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676015621131Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676015621131Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676015621131Cleaning up temporary data from old regions at 1676015621148 (+17 ms)Cleaning up detritus from prior splits at 1676015621149 (+1 ms)Region opened successfully at 1676015621157 (+8 ms) 2023-02-10 07:53:41,157 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 07:53:41,157 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 07:53:41,157 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 07:53:41,157 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 07:53:41,157 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 07:53:41,158 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 07:53:41,159 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676015621157Disabling compacts and flushes for region at 1676015621157Disabling writes for close at 1676015621157Writing region close event to WAL at 1676015621158 (+1 ms)Closed at 1676015621158 2023-02-10 07:53:41,165 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-10 07:53:41,165 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-10 07:53:41,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-10 07:53:41,183 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-10 07:53:41,186 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-10 07:53:41,338 DEBUG [jenkins-hbase4:42691] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-10 07:53:41,341 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36907,1676015618909, state=OPENING 2023-02-10 07:53:41,348 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-10 07:53:41,349 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:53:41,350 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 07:53:41,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:53:41,535 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:41,538 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 07:53:41,541 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58338, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 07:53:41,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-10 07:53:41,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-10 07:53:41,557 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36907%2C1676015618909.meta, suffix=.meta, logDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/WALs/jenkins-hbase4.apache.org,36907,1676015618909, archiveDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/oldWALs, maxLogs=32 2023-02-10 07:53:41,573 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33739,DS-96fb93ed-3ce2-40cd-962c-858ae93eaffb,DISK] 2023-02-10 07:53:41,577 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/WALs/jenkins-hbase4.apache.org,36907,1676015618909/jenkins-hbase4.apache.org%2C36907%2C1676015618909.meta.1676015621558.meta 2023-02-10 07:53:41,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33739,DS-96fb93ed-3ce2-40cd-962c-858ae93eaffb,DISK]] 2023-02-10 07:53:41,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:53:41,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-10 07:53:41,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-10 07:53:41,601 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-10 07:53:41,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-10 07:53:41,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:41,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-10 07:53:41,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-10 07:53:41,610 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-10 07:53:41,611 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/info 2023-02-10 07:53:41,612 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/info 2023-02-10 07:53:41,612 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-10 07:53:41,613 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:41,613 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-10 07:53:41,615 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/rep_barrier 2023-02-10 07:53:41,615 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/rep_barrier 2023-02-10 07:53:41,615 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-10 07:53:41,616 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:41,616 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-10 07:53:41,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/table 2023-02-10 07:53:41,618 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/table 2023-02-10 07:53:41,618 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-10 07:53:41,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:41,620 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740 2023-02-10 07:53:41,623 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740 2023-02-10 07:53:41,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-10 07:53:41,628 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-10 07:53:41,629 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61313862, jitterRate=-0.08635225892066956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-10 07:53:41,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676015621607Writing region info on filesystem at 1676015621608 (+1 ms)Initializing all the Stores at 1676015621609 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676015621609Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676015621610 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676015621610Cleaning up temporary data from old regions at 1676015621624 (+14 ms)Cleaning up detritus from prior splits at 1676015621625 (+1 ms)Running coprocessor post-open hooks at 1676015621630 (+5 ms)Region opened successfully at 1676015621630 2023-02-10 07:53:41,638 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676015621528 2023-02-10 07:53:41,654 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-10 07:53:41,655 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-10 07:53:41,656 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36907,1676015618909, state=OPEN 2023-02-10 07:53:41,660 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-10 07:53:41,660 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-10 07:53:41,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-10 07:53:41,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36907,1676015618909 in 308 msec 2023-02-10 07:53:41,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-10 07:53:41,669 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 493 msec 2023-02-10 07:53:41,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4810 sec 2023-02-10 07:53:41,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676015618966, completionTime=-1 2023-02-10 07:53:41,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-10 07:53:41,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-10 07:53:41,735 DEBUG [hconnection-0x2f5e6fb2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:53:41,739 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58350, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:53:41,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-10 07:53:41,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676015681754 2023-02-10 07:53:41,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676015741754 2023-02-10 07:53:41,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 78 msec 2023-02-10 07:53:41,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42691,1676015617779-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:41,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42691,1676015617779-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:41,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42691,1676015617779-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:41,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42691, period=300000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:41,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-10 07:53:41,785 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-10 07:53:41,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-10 07:53:41,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-10 07:53:41,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-10 07:53:41,805 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:53:41,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:53:41,830 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:41,832 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1 empty. 2023-02-10 07:53:41,833 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:41,833 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-10 07:53:42,255 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-10 07:53:42,257 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ec0b7cd10b34bade21334741c8efd2e1, NAME => 'hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:53:42,269 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:42,269 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ec0b7cd10b34bade21334741c8efd2e1, disabling compactions & flushes 2023-02-10 07:53:42,269 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:53:42,269 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:53:42,269 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. after waiting 0 ms 2023-02-10 07:53:42,269 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:53:42,269 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:53:42,269 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ec0b7cd10b34bade21334741c8efd2e1: Waiting for close lock at 1676015622269Disabling compacts and flushes for region at 1676015622269Disabling writes for close at 1676015622269Writing region close event to WAL at 1676015622269Closed at 1676015622269 2023-02-10 07:53:42,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:53:42,288 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676015622276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015622276"}]},"ts":"1676015622276"} 2023-02-10 07:53:42,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:53:42,316 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:53:42,321 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015622317"}]},"ts":"1676015622317"} 2023-02-10 07:53:42,325 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-10 07:53:42,334 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec0b7cd10b34bade21334741c8efd2e1, ASSIGN}] 2023-02-10 07:53:42,336 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ec0b7cd10b34bade21334741c8efd2e1, ASSIGN 2023-02-10 07:53:42,338 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ec0b7cd10b34bade21334741c8efd2e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:53:42,489 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec0b7cd10b34bade21334741c8efd2e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:42,489 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676015622488"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015622488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015622488"}]},"ts":"1676015622488"} 2023-02-10 07:53:42,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ec0b7cd10b34bade21334741c8efd2e1, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:53:42,653 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:53:42,654 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ec0b7cd10b34bade21334741c8efd2e1, NAME => 'hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:53:42,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:42,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:42,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:42,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:42,657 INFO [StoreOpener-ec0b7cd10b34bade21334741c8efd2e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:42,659 DEBUG [StoreOpener-ec0b7cd10b34bade21334741c8efd2e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1/info 2023-02-10 07:53:42,659 DEBUG [StoreOpener-ec0b7cd10b34bade21334741c8efd2e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1/info 2023-02-10 07:53:42,660 INFO [StoreOpener-ec0b7cd10b34bade21334741c8efd2e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec0b7cd10b34bade21334741c8efd2e1 columnFamilyName info 2023-02-10 07:53:42,661 INFO [StoreOpener-ec0b7cd10b34bade21334741c8efd2e1-1] regionserver.HStore(310): Store=ec0b7cd10b34bade21334741c8efd2e1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:42,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:42,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:42,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:53:42,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:53:42,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ec0b7cd10b34bade21334741c8efd2e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63121978, jitterRate=-0.05940923094749451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:53:42,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ec0b7cd10b34bade21334741c8efd2e1: Running coprocessor pre-open hook at 1676015622655Writing region info on filesystem at 1676015622655Initializing all the Stores at 1676015622657 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676015622657Cleaning up temporary data from old regions at 1676015622663 (+6 ms)Cleaning up detritus from prior splits at 1676015622664 (+1 ms)Running coprocessor post-open hooks at 1676015622671 (+7 ms)Region opened successfully at 1676015622671 2023-02-10 07:53:42,673 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1., pid=6, masterSystemTime=1676015622647 2023-02-10 07:53:42,677 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:53:42,677 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:53:42,679 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ec0b7cd10b34bade21334741c8efd2e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:42,679 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676015622678"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015622678"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015622678"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015622678"}]},"ts":"1676015622678"} 2023-02-10 07:53:42,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-10 07:53:42,686 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ec0b7cd10b34bade21334741c8efd2e1, server=jenkins-hbase4.apache.org,36907,1676015618909 in 189 msec 2023-02-10 07:53:42,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-10 07:53:42,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ec0b7cd10b34bade21334741c8efd2e1, ASSIGN in 352 msec 2023-02-10 07:53:42,691 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:53:42,691 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015622691"}]},"ts":"1676015622691"} 2023-02-10 07:53:42,694 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-10 07:53:42,697 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:53:42,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 902 msec 2023-02-10 07:53:42,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-10 07:53:42,708 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-10 07:53:42,708 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:53:42,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-10 07:53:42,757 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 07:53:42,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-02-10 07:53:42,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-10 07:53:42,787 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 07:53:42,792 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-02-10 07:53:42,802 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-10 07:53:42,805 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-10 07:53:42,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.831sec 2023-02-10 07:53:42,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-10 07:53:42,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-10 07:53:42,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-10 07:53:42,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42691,1676015617779-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-10 07:53:42,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42691,1676015617779-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-10 07:53:42,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-10 07:53:42,852 DEBUG [Listener at localhost/46793] zookeeper.ReadOnlyZKClient(139): Connect 0x6a675bd6 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:53:42,856 DEBUG [Listener at localhost/46793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@629018b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:53:42,869 DEBUG [hconnection-0x6392fb1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:53:42,880 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58352, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:53:42,890 INFO [Listener at localhost/46793] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:53:42,890 DEBUG [Listener at localhost/46793] zookeeper.ReadOnlyZKClient(139): Connect 0x6f46f74d to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:53:42,895 DEBUG [Listener at localhost/46793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7defec53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:53:42,895 INFO [Listener at localhost/46793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:53:42,916 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=168, AvailableMemoryMB=4357 2023-02-10 07:53:42,927 DEBUG [Listener at localhost/46793] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:53:42,931 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50414, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:53:42,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-10 07:53:42,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:42,946 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:53:42,948 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:53:42,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-10 07:53:42,951 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639 2023-02-10 07:53:42,952 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639 empty. 2023-02-10 07:53:42,954 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639 2023-02-10 07:53:42,954 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-10 07:53:42,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-10 07:53:43,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-10 07:53:43,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-10 07:53:43,371 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-10 07:53:43,373 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => b5f82c81215e78518187a3656676b639, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:53:43,385 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:43,385 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing b5f82c81215e78518187a3656676b639, disabling compactions & flushes 2023-02-10 07:53:43,385 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:43,385 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:43,385 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. after waiting 0 ms 2023-02-10 07:53:43,385 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:43,385 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:43,385 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for b5f82c81215e78518187a3656676b639: Waiting for close lock at 1676015623385Disabling compacts and flushes for region at 1676015623385Disabling writes for close at 1676015623385Writing region close event to WAL at 1676015623385Closed at 1676015623385 2023-02-10 07:53:43,389 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:53:43,391 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676015623391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015623391"}]},"ts":"1676015623391"} 2023-02-10 07:53:43,393 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:53:43,395 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:53:43,395 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015623395"}]},"ts":"1676015623395"} 2023-02-10 07:53:43,397 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-10 07:53:43,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b5f82c81215e78518187a3656676b639, ASSIGN}] 2023-02-10 07:53:43,403 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b5f82c81215e78518187a3656676b639, ASSIGN 2023-02-10 07:53:43,405 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b5f82c81215e78518187a3656676b639, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:53:43,556 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b5f82c81215e78518187a3656676b639, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:43,556 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676015623556"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015623556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015623556"}]},"ts":"1676015623556"} 2023-02-10 07:53:43,560 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure b5f82c81215e78518187a3656676b639, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:53:43,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-10 07:53:43,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:43,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b5f82c81215e78518187a3656676b639, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:53:43,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly b5f82c81215e78518187a3656676b639 2023-02-10 07:53:43,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:43,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b5f82c81215e78518187a3656676b639 2023-02-10 07:53:43,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b5f82c81215e78518187a3656676b639 2023-02-10 07:53:43,723 INFO [StoreOpener-b5f82c81215e78518187a3656676b639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b5f82c81215e78518187a3656676b639 2023-02-10 07:53:43,725 DEBUG [StoreOpener-b5f82c81215e78518187a3656676b639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:43,725 DEBUG [StoreOpener-b5f82c81215e78518187a3656676b639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:43,728 INFO [StoreOpener-b5f82c81215e78518187a3656676b639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5f82c81215e78518187a3656676b639 columnFamilyName family1 2023-02-10 07:53:43,731 INFO [StoreOpener-b5f82c81215e78518187a3656676b639-1] regionserver.HStore(310): Store=b5f82c81215e78518187a3656676b639/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:43,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639 2023-02-10 07:53:43,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639 2023-02-10 07:53:43,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b5f82c81215e78518187a3656676b639 2023-02-10 07:53:43,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:53:43,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b5f82c81215e78518187a3656676b639; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67509619, jitterRate=0.0059717148542404175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:53:43,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b5f82c81215e78518187a3656676b639: Running coprocessor pre-open hook at 1676015623720Writing region info on filesystem at 1676015623720Initializing all the Stores at 1676015623721 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676015623721Cleaning up temporary data from old regions at 1676015623735 (+14 ms)Cleaning up detritus from prior splits at 1676015623735Running coprocessor post-open hooks at 1676015623743 (+8 ms)Region opened successfully at 1676015623743 2023-02-10 07:53:43,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639., pid=11, masterSystemTime=1676015623713 2023-02-10 07:53:43,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:43,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:43,749 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=b5f82c81215e78518187a3656676b639, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:43,749 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676015623748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015623748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015623748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015623748"}]},"ts":"1676015623748"} 2023-02-10 07:53:43,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-10 07:53:43,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure b5f82c81215e78518187a3656676b639, server=jenkins-hbase4.apache.org,36907,1676015618909 in 192 msec 2023-02-10 07:53:43,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-10 07:53:43,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b5f82c81215e78518187a3656676b639, ASSIGN in 354 msec 2023-02-10 07:53:43,760 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:53:43,760 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015623760"}]},"ts":"1676015623760"} 2023-02-10 07:53:43,762 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-10 07:53:43,765 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:53:43,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 823 msec 2023-02-10 07:53:44,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-10 07:53:44,070 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-10 07:53:44,089 DEBUG [hconnection-0x462145a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:53:44,092 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:53:44,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:44,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,272 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:44,272 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:44,273 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:44,273 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:44,274 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,274 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,275 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:44,275 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:44,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:44,276 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,276 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:44,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:44,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,277 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,279 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:44,280 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:44,280 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:44,281 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:44,281 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:44,281 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:44,282 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:44,283 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-10 07:53:44,866 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304a1d3cf96ca347fab7e48649435269d1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304a1d3cf96ca347fab7e48649435269d1 2023-02-10 07:53:44,882 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/b7d7b122586e4120a3a6575428b3cbd2 2023-02-10 07:53:44,891 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/b7d7b122586e4120a3a6575428b3cbd2 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/b7d7b122586e4120a3a6575428b3cbd2 2023-02-10 07:53:44,901 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/b7d7b122586e4120a3a6575428b3cbd2, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-10 07:53:44,904 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 621ms, sequenceid=5, compaction requested=false 2023-02-10 07:53:44,905 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:44,908 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:44,908 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:44,908 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:44,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,912 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:44,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:44,913 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,913 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:44,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:44,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:44,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:44,915 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:44,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45a28b94[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:44,915 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,917 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:44,917 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,917 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:44,921 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,921 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:44,921 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:44,922 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:44,926 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:44,926 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:44,926 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:44,926 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,926 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:44,928 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,928 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,929 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:44,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:44,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:44,929 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:44,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:44,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,931 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:44,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,939 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,939 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:44,939 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:44,939 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:44,940 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:44,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:44,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:44,939 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,940 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:44,940 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,940 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,940 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:44,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:44,942 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:44,942 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:45,042 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:45,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:45,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,061 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:45,061 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:45,061 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:45,062 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:45,062 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,062 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,063 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:45,063 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:45,064 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,064 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:45,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:45,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,065 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,065 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:45,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:45,066 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:45,066 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:45,066 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:45,067 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-10 07:53:45,501 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128263494ea3dbc4a8aa6bb52045ecbe82c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128263494ea3dbc4a8aa6bb52045ecbe82c 2023-02-10 07:53:45,512 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/354382528304458f9d3ea3df63d597e7 2023-02-10 07:53:45,520 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/354382528304458f9d3ea3df63d597e7 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/354382528304458f9d3ea3df63d597e7 2023-02-10 07:53:45,528 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/354382528304458f9d3ea3df63d597e7, entries=1, sequenceid=9, filesize=5.0 K 2023-02-10 07:53:45,529 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 462ms, sequenceid=9, compaction requested=false 2023-02-10 07:53:45,530 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:45,530 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:45,530 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:45,530 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:45,530 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,530 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:45,530 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:45,534 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,534 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:45,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:45,534 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,534 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:45,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:45,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:45,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:45,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:45,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799868f[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:45,536 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:45,536 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,538 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:45,538 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:45,538 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:45,538 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,538 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:45,540 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,540 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:45,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:45,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:45,540 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:45,540 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:45,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:45,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:45,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:45,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:45,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:45,544 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:45,544 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:45,544 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:45,544 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,544 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:45,550 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,550 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:45,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,550 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:45,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:45,551 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,553 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,558 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:45,558 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:45,558 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:45,558 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:45,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:45,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:45,558 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,559 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,559 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,559 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-10 07:53:45,559 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,559 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:45,560 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:45,560 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:45,660 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:45,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:45,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:45,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:45,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,673 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:45,673 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:45,673 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:45,673 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:45,674 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,674 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,676 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:45,676 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:45,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,679 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,679 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:45,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:45,679 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:45,679 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:45,680 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:45,680 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:45,680 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:45,681 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:45,681 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:45,681 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:45,681 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:45,682 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:53:46,119 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201920acdc5064c46c8b137812e2e63a692 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201920acdc5064c46c8b137812e2e63a692 2023-02-10 07:53:46,419 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-10 07:53:46,420 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-10 07:53:46,536 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/00d787770c7b49a98a329cce7e468d85 2023-02-10 07:53:46,547 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/00d787770c7b49a98a329cce7e468d85 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/00d787770c7b49a98a329cce7e468d85 2023-02-10 07:53:46,558 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/00d787770c7b49a98a329cce7e468d85, entries=1, sequenceid=13, filesize=5.0 K 2023-02-10 07:53:46,559 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 877ms, sequenceid=13, compaction requested=true 2023-02-10 07:53:46,559 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:46,560 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,560 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:46,561 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:46,564 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,564 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:46,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:46,565 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,565 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:46,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:46,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:46,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26286120[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:46,568 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:46,568 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,569 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:46,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:46,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:46,570 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,570 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:46,572 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:46,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:46,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:46,572 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:46,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:46,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:46,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:46,577 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:46,577 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:46,577 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:46,577 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,577 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:46,579 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,579 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:46,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:46,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:46,580 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,582 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,584 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:46,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:46,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:46,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:46,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:46,596 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,596 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:46,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:46,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:46,596 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:46,597 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:46,598 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:46,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-10 07:53:46,698 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:46,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:46,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:46,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:46,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,716 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:46,716 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:46,720 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:46,720 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:46,721 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,721 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,723 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:46,723 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:46,723 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:46,723 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:46,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:46,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,725 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,725 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:46,725 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:46,725 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:46,725 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:46,726 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:46,726 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:46,726 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:46,726 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:46,726 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:46,726 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:53:47,136 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:53:47,165 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120559783422edbc4ae29b0dae4bfcdb5160 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120559783422edbc4ae29b0dae4bfcdb5160 2023-02-10 07:53:47,591 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/c2b244d3efb54e43a406f29f27cc9710 2023-02-10 07:53:47,600 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/c2b244d3efb54e43a406f29f27cc9710 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/c2b244d3efb54e43a406f29f27cc9710 2023-02-10 07:53:47,608 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/c2b244d3efb54e43a406f29f27cc9710, entries=1, sequenceid=17, filesize=5.0 K 2023-02-10 07:53:47,610 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 884ms, sequenceid=17, compaction requested=true 2023-02-10 07:53:47,610 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:47,610 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:47,610 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:47,610 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:47,610 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,610 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:47,610 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:47,612 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:47,613 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,613 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:47,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@630e9eed[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:47,615 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:47,615 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,616 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:47,617 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:47,617 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:47,617 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,617 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:47,619 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,619 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:47,620 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:47,620 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:47,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:47,624 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:47,624 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:47,624 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:47,624 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,624 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:47,625 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,625 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,625 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:47,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:47,626 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,628 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,632 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,632 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,632 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,632 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:47,632 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,632 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:47,632 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:47,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:47,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-10 07:53:47,632 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:47,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:47,633 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:47,633 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:47,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:47,634 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:47,634 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:47,734 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:47,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:47,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:47,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:47,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,745 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:47,745 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:47,746 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:47,746 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:47,746 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,746 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,747 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:47,748 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:47,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:47,748 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:47,748 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:47,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:47,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,749 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,749 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:47,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:47,749 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:47,749 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:47,750 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:47,750 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:47,750 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:47,750 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:47,750 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:47,750 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:53:47,932 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 07:53:47,933 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-10 07:53:48,173 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e776356a6c4148259aa8082dbe192db3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e776356a6c4148259aa8082dbe192db3 2023-02-10 07:53:48,184 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/fd0abaaa40d34fa68c85f3e6cf147115 2023-02-10 07:53:48,192 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/fd0abaaa40d34fa68c85f3e6cf147115 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/fd0abaaa40d34fa68c85f3e6cf147115 2023-02-10 07:53:48,199 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/fd0abaaa40d34fa68c85f3e6cf147115, entries=1, sequenceid=21, filesize=5.0 K 2023-02-10 07:53:48,201 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 451ms, sequenceid=21, compaction requested=true 2023-02-10 07:53:48,201 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:48,201 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:48,201 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:48,201 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:48,201 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,201 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:48,202 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:48,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,208 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:48,208 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,208 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:48,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:48,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:48,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:48,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:48,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32a15733[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:48,210 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:48,210 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,211 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:48,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:48,212 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,212 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:48,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:48,213 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,213 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:48,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:48,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:48,213 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:48,213 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:48,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:48,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:48,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:48,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:48,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:48,216 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:48,216 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:48,216 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:48,216 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,216 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:48,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:48,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:48,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:48,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:48,220 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:48,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,222 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:48,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,225 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,225 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:48,225 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:48,225 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:48,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:48,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:48,225 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:48,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:48,225 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,225 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,226 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,226 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,226 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,226 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:48,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:48,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:48,226 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:48,326 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:48,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:48,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:48,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:48,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,337 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:48,337 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:48,338 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:48,338 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:48,338 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,338 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,340 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,340 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:48,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:48,340 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:48,340 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,341 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:48,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:48,341 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:48,341 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:48,342 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:48,342 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:48,342 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:48,342 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:48,342 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:48,342 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:53:48,767 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cb660fafcd314919814dcc28cdef37ec to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231cb660fafcd314919814dcc28cdef37ec 2023-02-10 07:53:49,177 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/e307244b4699450a965626d422730f23 2023-02-10 07:53:49,186 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/e307244b4699450a965626d422730f23 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e307244b4699450a965626d422730f23 2023-02-10 07:53:49,194 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e307244b4699450a965626d422730f23, entries=1, sequenceid=25, filesize=5.0 K 2023-02-10 07:53:49,196 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 854ms, sequenceid=25, compaction requested=true 2023-02-10 07:53:49,196 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:49,197 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:49,197 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:49,197 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:49,197 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,197 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:49,197 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:49,199 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,199 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:49,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:49,199 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,199 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:49,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:49,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:49,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:49,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:49,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79c71216[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:49,202 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:49,202 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,203 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,203 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:49,203 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:49,203 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:49,203 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,203 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:49,205 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:49,205 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:49,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:49,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:49,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:49,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:49,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:49,208 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:49,208 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:49,208 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:49,209 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,209 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:49,211 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,211 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,211 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:49,212 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:49,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,214 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:49,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,216 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:49,216 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:49,216 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:49,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:49,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:49,216 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:49,216 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-10 07:53:49,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:49,217 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:49,218 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:49,318 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:49,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:49,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:49,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:49,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,330 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:49,330 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:49,330 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:49,330 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:49,331 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,331 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,332 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,332 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:49,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:49,333 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:49,333 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:49,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,334 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,334 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:49,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:49,334 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:49,334 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:49,334 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:49,335 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:49,335 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:49,335 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:49,335 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:49,335 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:53:49,757 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010102fde1d876b14efa9c27e961b7de569d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010102fde1d876b14efa9c27e961b7de569d 2023-02-10 07:53:50,166 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/256f005a77be49f3b28b1938814160b9 2023-02-10 07:53:50,174 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/256f005a77be49f3b28b1938814160b9 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/256f005a77be49f3b28b1938814160b9 2023-02-10 07:53:50,182 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/256f005a77be49f3b28b1938814160b9, entries=1, sequenceid=29, filesize=5.0 K 2023-02-10 07:53:50,183 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 848ms, sequenceid=29, compaction requested=true 2023-02-10 07:53:50,183 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:50,184 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:50,184 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:50,184 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:50,184 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,184 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:50,184 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:50,186 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,186 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:50,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:50,186 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,186 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:50,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:50,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:50,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:50,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:50,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c035d6f[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:50,188 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:50,188 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,190 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,190 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:50,190 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:50,190 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:50,191 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,191 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:50,192 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:50,192 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:50,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,192 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:50,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:50,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:50,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:50,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:50,196 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:50,196 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:50,196 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:50,196 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,196 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:50,197 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,197 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,197 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:50,198 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,199 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:50,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,206 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,206 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,206 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:50,206 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:50,206 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:50,206 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:50,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:50,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:50,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:50,207 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,207 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,207 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,207 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,207 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:50,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:50,207 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:50,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:50,308 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:50,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:50,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:50,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:50,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,318 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:50,318 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:50,319 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:50,319 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:50,319 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,319 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,321 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:50,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:50,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:50,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:50,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:50,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:50,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,322 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,322 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:50,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:50,322 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:50,323 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:50,323 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:50,323 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:50,323 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:50,323 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:50,323 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:50,323 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:53:50,747 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103afb13aba4be54d54a2aec27f5f1898f2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103afb13aba4be54d54a2aec27f5f1898f2 2023-02-10 07:53:51,155 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/3330c57b7aa4443fa7e83db4bdea27d6 2023-02-10 07:53:51,164 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/3330c57b7aa4443fa7e83db4bdea27d6 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/3330c57b7aa4443fa7e83db4bdea27d6 2023-02-10 07:53:51,171 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/3330c57b7aa4443fa7e83db4bdea27d6, entries=1, sequenceid=33, filesize=5.0 K 2023-02-10 07:53:51,172 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 849ms, sequenceid=33, compaction requested=true 2023-02-10 07:53:51,172 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:51,172 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:51,172 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:51,173 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:51,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,175 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:51,175 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,175 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:51,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:51,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:51,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b6d41f4[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:51,177 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:51,177 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,178 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:51,179 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:51,179 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:51,179 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,179 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:51,181 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:51,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:51,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:51,182 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:51,182 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:51,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:51,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:51,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:51,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:51,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:51,184 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:51,184 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:51,184 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:51,185 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,185 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:51,187 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,187 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,187 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:51,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:51,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:51,187 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:51,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:51,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:51,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:51,189 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:51,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:51,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:51,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:51,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:51,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-10 07:53:51,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:51,193 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:51,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:51,193 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:51,193 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:51,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:51,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:51,293 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:51,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:51,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:51,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:51,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,304 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:51,304 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:51,304 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:51,304 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:51,305 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,305 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,306 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:51,306 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:51,307 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:51,307 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:51,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,308 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:51,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:51,309 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:51,309 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:51,309 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:51,310 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:51,310 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:51,310 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:51,310 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:51,310 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:53:51,730 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071984ae19783043b6b7e54d519d87a475 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509071984ae19783043b6b7e54d519d87a475 2023-02-10 07:53:52,139 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/123ab78cb92040ec9b74182c99d02dd4 2023-02-10 07:53:52,147 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/123ab78cb92040ec9b74182c99d02dd4 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/123ab78cb92040ec9b74182c99d02dd4 2023-02-10 07:53:52,154 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/123ab78cb92040ec9b74182c99d02dd4, entries=1, sequenceid=37, filesize=5.0 K 2023-02-10 07:53:52,155 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 845ms, sequenceid=37, compaction requested=true 2023-02-10 07:53:52,155 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:52,155 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:52,155 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:52,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:52,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:52,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:52,159 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,159 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:52,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:52,160 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,160 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:52,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:52,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33cd9765[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:52,161 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:52,161 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,162 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,163 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:52,163 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:52,163 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,163 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:52,163 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:52,164 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,164 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:52,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:52,164 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:52,164 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:52,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:52,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:52,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:52,167 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:52,167 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:52,167 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:52,167 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,167 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:52,169 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,169 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,169 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:52,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:52,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:52,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:52,170 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,171 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:52,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:52,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,175 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:52,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:52,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:52,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-10 07:53:52,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:52,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:52,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:52,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:52,176 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:52,176 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:52,276 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:52,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:52,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:53:52,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-10 07:53:52,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,287 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:52,287 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:52,287 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-10 07:53:52,288 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-10 07:53:52,288 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,288 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,290 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,290 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:52,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:52,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:52,290 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:52,290 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:53:52,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:53:52,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,291 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,291 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-10 07:53:52,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:52,291 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-10 07:53:52,291 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:53:52,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-10 07:53:52,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:53:52,293 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:53:52,293 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:52,293 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. started... 2023-02-10 07:53:52,293 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b5f82c81215e78518187a3656676b639 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:53:52,713 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112042bc3d1bd1154e5eae467be95729ed94 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112042bc3d1bd1154e5eae467be95729ed94 2023-02-10 07:53:53,121 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/317f081d3b554a709005d870a5fa646a 2023-02-10 07:53:53,129 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/317f081d3b554a709005d870a5fa646a as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/317f081d3b554a709005d870a5fa646a 2023-02-10 07:53:53,136 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/317f081d3b554a709005d870a5fa646a, entries=1, sequenceid=41, filesize=5.0 K 2023-02-10 07:53:53,137 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5f82c81215e78518187a3656676b639 in 844ms, sequenceid=41, compaction requested=true 2023-02-10 07:53:53,137 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:53,137 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:53,137 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:53:53,138 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:53:53,138 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,138 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-10 07:53:53,138 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-10 07:53:53,139 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,140 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:53,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:53,140 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,140 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:53:53,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:53,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:53,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:53,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-10 07:53:53,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72db74a8[Count = 0] remaining members to acquire global barrier 2023-02-10 07:53:53,142 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-10 07:53:53,142 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,143 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,143 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-10 07:53:53,143 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-10 07:53:53,143 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:53:53,143 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,143 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:53:53,147 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,147 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-10 07:53:53,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,147 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:53,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:53,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:53,148 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-10 07:53:53,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:53,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:53,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:53,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:53:53,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-10 07:53:53,151 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-10 07:53:53,151 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:53:53,151 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:53:53,151 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,151 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:53:53,153 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,153 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:53:53,153 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:53,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:53:53,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:53,154 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:53:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:53:53,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,155 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:53:53,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,157 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:53:53,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:53:53,158 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:53:53,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-10 07:53:53,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:53:53,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-10 07:53:53,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:53:53,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:53:53,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:53,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:53:53,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:53:53,159 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-10 07:53:53,159 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:53:53,259 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:53:53,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:53:53,265 DEBUG [Listener at localhost/46793] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 07:53:53,268 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 07:53:53,269 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:53,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-10 07:53:53,285 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-10 07:53:53,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:53:53,286 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016233286 2023-02-10 07:53:53,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:53:53,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-10 07:53:53,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:53,294 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x3244f326 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:53:53,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23d54594, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:53:53,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,198 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010361b78ff9f4e84d08a9e27c5187ce1a93 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010361b78ff9f4e84d08a9e27c5187ce1a93 2023-02-10 07:53:54,199 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:54,217 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:53:54,219 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34212, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:53:54,230 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:53:54,231 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34236, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:53:54,265 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/39aa521ab65d4c1f9a434eb7a0ab6f65 first=Optional[r3] last=Optional[r6] 2023-02-10 07:53:54,278 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/39aa521ab65d4c1f9a434eb7a0ab6f65}] 2023-02-10 07:53:54,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/39aa521ab65d4c1f9a434eb7a0ab6f65 for inclusion in b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:54,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-10 07:53:54,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:53:54,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:54,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/39aa521ab65d4c1f9a434eb7a0ab6f65 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vto95qv0gonfqbn3032joqtei1eoa6fdoui6o8s6red9vdfkgrsgdi5d8chsite9/family1/39aa521ab65d4c1f9a434eb7a0ab6f65 2023-02-10 07:53:54,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vto95qv0gonfqbn3032joqtei1eoa6fdoui6o8s6red9vdfkgrsgdi5d8chsite9/family1/39aa521ab65d4c1f9a434eb7a0ab6f65 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_ 2023-02-10 07:53:54,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vto95qv0gonfqbn3032joqtei1eoa6fdoui6o8s6red9vdfkgrsgdi5d8chsite9/family1/39aa521ab65d4c1f9a434eb7a0ab6f65 into b5f82c81215e78518187a3656676b639/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_ - updating store file list. 2023-02-10 07:53:54,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_ into b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:54,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vto95qv0gonfqbn3032joqtei1eoa6fdoui6o8s6red9vdfkgrsgdi5d8chsite9/family1/39aa521ab65d4c1f9a434eb7a0ab6f65 into b5f82c81215e78518187a3656676b639/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_) 2023-02-10 07:53:54,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__vto95qv0gonfqbn3032joqtei1eoa6fdoui6o8s6red9vdfkgrsgdi5d8chsite9/family1/39aa521ab65d4c1f9a434eb7a0ab6f65 2023-02-10 07:53:54,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-10 07:53:54,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-10 07:53:54,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): b5f82c81215e78518187a3656676b639/family1 is initiating minor compaction 2023-02-10 07:53:54,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@57b7df2e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:53:54,323 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of b5f82c81215e78518187a3656676b639/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:54,324 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/354382528304458f9d3ea3df63d597e7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/00d787770c7b49a98a329cce7e468d85, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/c2b244d3efb54e43a406f29f27cc9710, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/fd0abaaa40d34fa68c85f3e6cf147115, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e307244b4699450a965626d422730f23, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/256f005a77be49f3b28b1938814160b9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/3330c57b7aa4443fa7e83db4bdea27d6, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/123ab78cb92040ec9b74182c99d02dd4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/317f081d3b554a709005d870a5fa646a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp, totalSize=50.2 K 2023-02-10 07:53:54,325 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 354382528304458f9d3ea3df63d597e7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-10 07:53:54,325 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 00d787770c7b49a98a329cce7e468d85, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-10 07:53:54,325 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting c2b244d3efb54e43a406f29f27cc9710, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-10 07:53:54,325 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting fd0abaaa40d34fa68c85f3e6cf147115, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-10 07:53:54,325 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting e307244b4699450a965626d422730f23, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-10 07:53:54,325 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 256f005a77be49f3b28b1938814160b9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-10 07:53:54,325 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 3330c57b7aa4443fa7e83db4bdea27d6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-10 07:53:54,326 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 123ab78cb92040ec9b74182c99d02dd4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-10 07:53:54,326 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 317f081d3b554a709005d870a5fa646a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-10 07:53:54,326 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-10 07:53:54,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:54,341 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:53:54,346 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e776356a6c4148259aa8082dbe192db3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228e776356a6c4148259aa8082dbe192db3 2023-02-10 07:53:54,348 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231cb660fafcd314919814dcc28cdef37ec to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231cb660fafcd314919814dcc28cdef37ec 2023-02-10 07:53:54,350 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010102fde1d876b14efa9c27e961b7de569d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010102fde1d876b14efa9c27e961b7de569d 2023-02-10 07:53:54,351 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103afb13aba4be54d54a2aec27f5f1898f2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103afb13aba4be54d54a2aec27f5f1898f2 2023-02-10 07:53:54,352 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-10 07:53:54,352 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-10 07:53:54,352 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,352 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,352 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,352 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,353 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,353 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,353 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,353 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:54,377 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5f82c81215e78518187a3656676b639#family1#compaction#10 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:53:55,204 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/e71b506f1b0e464187d32b07a0aac4a1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e71b506f1b0e464187d32b07a0aac4a1 2023-02-10 07:53:55,219 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b5f82c81215e78518187a3656676b639/family1 of b5f82c81215e78518187a3656676b639 into e71b506f1b0e464187d32b07a0aac4a1(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:53:55,219 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:55,221 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676015634321; duration=0sec 2023-02-10 07:53:55,222 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:53:55,237 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057e10e8c834a64782aa4febbee97373a8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512057e10e8c834a64782aa4febbee97373a8 2023-02-10 07:53:55,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:55,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/354382528304458f9d3ea3df63d597e7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/00d787770c7b49a98a329cce7e468d85, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/c2b244d3efb54e43a406f29f27cc9710, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/fd0abaaa40d34fa68c85f3e6cf147115, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e307244b4699450a965626d422730f23, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/256f005a77be49f3b28b1938814160b9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/3330c57b7aa4443fa7e83db4bdea27d6, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/123ab78cb92040ec9b74182c99d02dd4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/317f081d3b554a709005d870a5fa646a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_] to archive 2023-02-10 07:53:55,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:53:55,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/354382528304458f9d3ea3df63d597e7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/354382528304458f9d3ea3df63d597e7 2023-02-10 07:53:55,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/00d787770c7b49a98a329cce7e468d85 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/00d787770c7b49a98a329cce7e468d85 2023-02-10 07:53:55,280 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9ad18058018d4022aed9e771f5fe60d7 first=Optional[r00] last=Optional[r2] 2023-02-10 07:53:55,281 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9ad18058018d4022aed9e771f5fe60d7}] 2023-02-10 07:53:55,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/c2b244d3efb54e43a406f29f27cc9710 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/c2b244d3efb54e43a406f29f27cc9710 2023-02-10 07:53:55,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/fd0abaaa40d34fa68c85f3e6cf147115 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/fd0abaaa40d34fa68c85f3e6cf147115 2023-02-10 07:53:55,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9ad18058018d4022aed9e771f5fe60d7 for inclusion in b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:55,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e307244b4699450a965626d422730f23 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e307244b4699450a965626d422730f23 2023-02-10 07:53:55,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/256f005a77be49f3b28b1938814160b9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/256f005a77be49f3b28b1938814160b9 2023-02-10 07:53:55,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-10 07:53:55,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:53:55,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:55,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/3330c57b7aa4443fa7e83db4bdea27d6 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/3330c57b7aa4443fa7e83db4bdea27d6 2023-02-10 07:53:55,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9ad18058018d4022aed9e771f5fe60d7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8o13kq7askt1sh7h6kqa3epe4d6b6ulvvmmctelle2b6ts2l5u50knfui43i55qe/family1/9ad18058018d4022aed9e771f5fe60d7 2023-02-10 07:53:55,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/123ab78cb92040ec9b74182c99d02dd4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/123ab78cb92040ec9b74182c99d02dd4 2023-02-10 07:53:55,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/317f081d3b554a709005d870a5fa646a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/317f081d3b554a709005d870a5fa646a 2023-02-10 07:53:55,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8o13kq7askt1sh7h6kqa3epe4d6b6ulvvmmctelle2b6ts2l5u50knfui43i55qe/family1/9ad18058018d4022aed9e771f5fe60d7 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/28043102e9604c798c82b60d51327947_SeqId_47_ 2023-02-10 07:53:55,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8o13kq7askt1sh7h6kqa3epe4d6b6ulvvmmctelle2b6ts2l5u50knfui43i55qe/family1/9ad18058018d4022aed9e771f5fe60d7 into b5f82c81215e78518187a3656676b639/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/28043102e9604c798c82b60d51327947_SeqId_47_ - updating store file list. 2023-02-10 07:53:55,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e9e876bdbf1241a09b3ed8950b3bfc53_SeqId_44_ 2023-02-10 07:53:55,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/28043102e9604c798c82b60d51327947_SeqId_47_ into b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:55,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8o13kq7askt1sh7h6kqa3epe4d6b6ulvvmmctelle2b6ts2l5u50knfui43i55qe/family1/9ad18058018d4022aed9e771f5fe60d7 into b5f82c81215e78518187a3656676b639/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/28043102e9604c798c82b60d51327947_SeqId_47_) 2023-02-10 07:53:55,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8o13kq7askt1sh7h6kqa3epe4d6b6ulvvmmctelle2b6ts2l5u50knfui43i55qe/family1/9ad18058018d4022aed9e771f5fe60d7 2023-02-10 07:53:55,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-10 07:53:55,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-10 07:53:55,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): b5f82c81215e78518187a3656676b639/family1 is initiating minor compaction (all files) 2023-02-10 07:53:55,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4af6c7d6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:53:55,313 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of b5f82c81215e78518187a3656676b639/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:55,314 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/b7d7b122586e4120a3a6575428b3cbd2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e71b506f1b0e464187d32b07a0aac4a1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/28043102e9604c798c82b60d51327947_SeqId_47_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp, totalSize=358.6 K 2023-02-10 07:53:55,314 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting b7d7b122586e4120a3a6575428b3cbd2, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842896 2023-02-10 07:53:55,315 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting e71b506f1b0e464187d32b07a0aac4a1, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242896 2023-02-10 07:53:55,316 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 28043102e9604c798c82b60d51327947_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842896 2023-02-10 07:53:55,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:55,317 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:53:55,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304a1d3cf96ca347fab7e48649435269d1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511304a1d3cf96ca347fab7e48649435269d1 2023-02-10 07:53:55,322 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201920acdc5064c46c8b137812e2e63a692 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201920acdc5064c46c8b137812e2e63a692 2023-02-10 07:53:55,323 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120559783422edbc4ae29b0dae4bfcdb5160 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120559783422edbc4ae29b0dae4bfcdb5160 2023-02-10 07:53:55,324 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-10 07:53:55,324 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-10 07:53:55,325 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:55,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:55,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:53:55,326 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-10 07:53:55,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0520 sec 2023-02-10 07:53:55,362 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5f82c81215e78518187a3656676b639#family1#compaction#11 average throughput is 6.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:53:55,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-10 07:53:55,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:55,906 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-10 07:53:55,907 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-10 07:53:55,907 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-10 07:53:55,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-10 07:53:55,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b5f82c81215e78518187a3656676b639, REOPEN/MOVE}] 2023-02-10 07:53:55,925 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b5f82c81215e78518187a3656676b639, REOPEN/MOVE 2023-02-10 07:53:55,926 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b5f82c81215e78518187a3656676b639, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:55,926 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676015635926"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015635926"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015635926"}]},"ts":"1676015635926"} 2023-02-10 07:53:55,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure b5f82c81215e78518187a3656676b639, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:53:56,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b5f82c81215e78518187a3656676b639, disabling compactions & flushes 2023-02-10 07:53:56,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:56,590 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/.tmp/family1/0e63a467fa50495987aa8124a7d4d2e2 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/0e63a467fa50495987aa8124a7d4d2e2 2023-02-10 07:53:56,597 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b5f82c81215e78518187a3656676b639/family1 of b5f82c81215e78518187a3656676b639 into 0e63a467fa50495987aa8124a7d4d2e2(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:53:56,597 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:56,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:56,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:56,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. after waiting 0 ms 2023-02-10 07:53:56,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:56,597 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1676015635313; duration=1sec 2023-02-10 07:53:56,597 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:53:56,600 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/b7d7b122586e4120a3a6575428b3cbd2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e71b506f1b0e464187d32b07a0aac4a1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/28043102e9604c798c82b60d51327947_SeqId_47_] to archive 2023-02-10 07:53:56,600 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:53:56,602 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/b7d7b122586e4120a3a6575428b3cbd2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/b7d7b122586e4120a3a6575428b3cbd2 2023-02-10 07:53:56,604 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e71b506f1b0e464187d32b07a0aac4a1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/e71b506f1b0e464187d32b07a0aac4a1 2023-02-10 07:53:56,605 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/28043102e9604c798c82b60d51327947_SeqId_47_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/28043102e9604c798c82b60d51327947_SeqId_47_ 2023-02-10 07:53:56,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-10 07:53:56,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:56,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b5f82c81215e78518187a3656676b639: Waiting for close lock at 1676015636087Running coprocessor pre-close hooks at 1676015636087Disabling compacts and flushes for region at 1676015636087Disabling writes for close at 1676015636597 (+510 ms)Writing region close event to WAL at 1676015636608 (+11 ms)Running coprocessor post-close hooks at 1676015636613 (+5 ms)Closed at 1676015636614 (+1 ms) 2023-02-10 07:53:56,614 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: b5f82c81215e78518187a3656676b639 to self. 2023-02-10 07:53:56,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,617 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b5f82c81215e78518187a3656676b639, regionState=CLOSED 2023-02-10 07:53:56,617 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676015636617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015636617"}]},"ts":"1676015636617"} 2023-02-10 07:53:56,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-10 07:53:56,621 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure b5f82c81215e78518187a3656676b639, server=jenkins-hbase4.apache.org,36907,1676015618909 in 690 msec 2023-02-10 07:53:56,622 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b5f82c81215e78518187a3656676b639, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=true 2023-02-10 07:53:56,772 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b5f82c81215e78518187a3656676b639, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:56,772 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676015636772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015636772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015636772"}]},"ts":"1676015636772"} 2023-02-10 07:53:56,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure b5f82c81215e78518187a3656676b639, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:53:56,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:56,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b5f82c81215e78518187a3656676b639, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:53:56,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:56,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,933 INFO [StoreOpener-b5f82c81215e78518187a3656676b639-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,934 DEBUG [StoreOpener-b5f82c81215e78518187a3656676b639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:56,934 DEBUG [StoreOpener-b5f82c81215e78518187a3656676b639-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:56,935 INFO [StoreOpener-b5f82c81215e78518187a3656676b639-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5f82c81215e78518187a3656676b639 columnFamilyName family1 2023-02-10 07:53:56,942 DEBUG [StoreOpener-b5f82c81215e78518187a3656676b639-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/0e63a467fa50495987aa8124a7d4d2e2 2023-02-10 07:53:56,943 INFO [StoreOpener-b5f82c81215e78518187a3656676b639-1] regionserver.HStore(310): Store=b5f82c81215e78518187a3656676b639/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:56,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b5f82c81215e78518187a3656676b639 2023-02-10 07:53:56,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b5f82c81215e78518187a3656676b639; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73166213, jitterRate=0.0902615338563919}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:53:56,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b5f82c81215e78518187a3656676b639: Running coprocessor pre-open hook at 1676015636932Writing region info on filesystem at 1676015636932Initializing all the Stores at 1676015636933 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676015636933Cleaning up temporary data from old regions at 1676015636945 (+12 ms)Cleaning up detritus from prior splits at 1676015636946 (+1 ms)Running coprocessor post-open hooks at 1676015636949 (+3 ms)Region opened successfully at 1676015636949 2023-02-10 07:53:56,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639., pid=17, masterSystemTime=1676015636927 2023-02-10 07:53:56,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:56,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:53:56,953 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b5f82c81215e78518187a3656676b639, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:56,953 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676015636952"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015636952"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015636952"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015636952"}]},"ts":"1676015636952"} 2023-02-10 07:53:56,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-10 07:53:56,957 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure b5f82c81215e78518187a3656676b639, server=jenkins-hbase4.apache.org,36907,1676015618909 in 179 msec 2023-02-10 07:53:56,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-10 07:53:56,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=b5f82c81215e78518187a3656676b639, REOPEN/MOVE in 1.0330 sec 2023-02-10 07:53:56,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-10 07:53:56,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0500 sec 2023-02-10 07:53:56,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4820 sec 2023-02-10 07:53:56,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-10 07:53:56,974 INFO [Listener at localhost/46793] compactions.TestMobCompactor(278): alter status finished 2023-02-10 07:53:56,975 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-10 07:53:56,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-10 07:53:56,977 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-10 07:53:56,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:53:56,978 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016236978 2023-02-10 07:53:56,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:53:56,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-10 07:53:56,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:56,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x22d682cf to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:53:56,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4372d46b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:53:56,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:56,987 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:56,987 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:56,987 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:56,987 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:57,822 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285a5891986b1846d99aee798b7a771960 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285a5891986b1846d99aee798b7a771960 2023-02-10 07:53:57,823 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:57,836 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:53:57,837 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34218, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:53:57,845 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:53:57,846 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34250, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:53:57,857 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a21af2ac9a64fe6af8449676787e31a first=Optional[r05] last=Optional[r8] 2023-02-10 07:53:57,858 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a21af2ac9a64fe6af8449676787e31a}] 2023-02-10 07:53:57,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a21af2ac9a64fe6af8449676787e31a for inclusion in b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:57,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-10 07:53:57,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:53:57,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for b5f82c81215e78518187a3656676b639: 2023-02-10 07:53:57,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a21af2ac9a64fe6af8449676787e31a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u80ollguma63crvveud7n7edanu92cbckqah2t5chr7ul8406c77tsklnk6p87fn/family1/7a21af2ac9a64fe6af8449676787e31a 2023-02-10 07:53:57,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u80ollguma63crvveud7n7edanu92cbckqah2t5chr7ul8406c77tsklnk6p87fn/family1/7a21af2ac9a64fe6af8449676787e31a as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/2b4c398646be4057958d2bb8a4406346_SeqId_53_ 2023-02-10 07:53:57,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u80ollguma63crvveud7n7edanu92cbckqah2t5chr7ul8406c77tsklnk6p87fn/family1/7a21af2ac9a64fe6af8449676787e31a into b5f82c81215e78518187a3656676b639/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/2b4c398646be4057958d2bb8a4406346_SeqId_53_ - updating store file list. 2023-02-10 07:53:57,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/2b4c398646be4057958d2bb8a4406346_SeqId_53_ into b5f82c81215e78518187a3656676b639/family1 2023-02-10 07:53:57,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u80ollguma63crvveud7n7edanu92cbckqah2t5chr7ul8406c77tsklnk6p87fn/family1/7a21af2ac9a64fe6af8449676787e31a into b5f82c81215e78518187a3656676b639/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/family1/2b4c398646be4057958d2bb8a4406346_SeqId_53_) 2023-02-10 07:53:57,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__u80ollguma63crvveud7n7edanu92cbckqah2t5chr7ul8406c77tsklnk6p87fn/family1/7a21af2ac9a64fe6af8449676787e31a 2023-02-10 07:53:57,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:57,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:53:57,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112042bc3d1bd1154e5eae467be95729ed94 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112042bc3d1bd1154e5eae467be95729ed94 2023-02-10 07:53:57,884 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128263494ea3dbc4a8aa6bb52045ecbe82c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128263494ea3dbc4a8aa6bb52045ecbe82c 2023-02-10 07:53:57,884 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-10 07:53:57,884 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-10 07:53:57,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:57,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:57,885 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-10 07:53:57,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-10 07:53:57,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:53:57,886 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-10 07:53:57,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 911 msec 2023-02-10 07:53:57,965 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=247 (was 210) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:42946 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x431d0422-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/cluster_ca906608-436c-7df5-28a0-58c9b32cd1e1/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:36907-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:43560 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:42982 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:42994 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:42996 [Waiting for operation #23] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1260592341_15 at /127.0.0.1:43600 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:43626 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:43704 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x3244f326-SendThread(127.0.0.1:54857) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/cluster_ca906608-436c-7df5-28a0-58c9b32cd1e1/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x431d0422-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x5c156f04-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x3244f326 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1012379153.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x22d682cf-SendThread(127.0.0.1:54857) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x5c156f04-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:43654 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:42992 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:42984 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:43562 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c156f04-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x22d682cf-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x22d682cf sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1012379153.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:42962 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x3244f326-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:43648 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=586 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=326 (was 409), ProcessCount=168 (was 168), AvailableMemoryMB=4222 (was 4357) 2023-02-10 07:53:57,979 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=586, MaxFileDescriptor=60000, SystemLoadAverage=326, ProcessCount=168, AvailableMemoryMB=4221 2023-02-10 07:53:57,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-10 07:53:57,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-10 07:53:57,984 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:53:57,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-10 07:53:57,985 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:53:57,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-10 07:53:57,987 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:57,987 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138 empty. 2023-02-10 07:53:57,988 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:57,988 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-10 07:53:58,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-10 07:53:58,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-10 07:53:58,400 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-10 07:53:58,402 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4e83904c81c27c815abba8b3a1837138, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:53:58,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-10 07:53:58,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:58,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 4e83904c81c27c815abba8b3a1837138, disabling compactions & flushes 2023-02-10 07:53:58,809 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:53:58,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:53:58,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. after waiting 0 ms 2023-02-10 07:53:58,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:53:58,809 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:53:58,809 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 4e83904c81c27c815abba8b3a1837138: Waiting for close lock at 1676015638809Disabling compacts and flushes for region at 1676015638809Disabling writes for close at 1676015638809Writing region close event to WAL at 1676015638809Closed at 1676015638809 2023-02-10 07:53:58,812 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:53:58,814 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676015638813"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015638813"}]},"ts":"1676015638813"} 2023-02-10 07:53:58,815 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:53:58,816 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:53:58,817 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015638816"}]},"ts":"1676015638816"} 2023-02-10 07:53:58,818 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-10 07:53:58,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=4e83904c81c27c815abba8b3a1837138, ASSIGN}] 2023-02-10 07:53:58,822 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=4e83904c81c27c815abba8b3a1837138, ASSIGN 2023-02-10 07:53:58,823 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=4e83904c81c27c815abba8b3a1837138, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:53:58,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4e83904c81c27c815abba8b3a1837138, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:58,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676015638974"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015638974"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015638974"}]},"ts":"1676015638974"} 2023-02-10 07:53:58,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 4e83904c81c27c815abba8b3a1837138, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:53:59,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-10 07:53:59,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:53:59,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e83904c81c27c815abba8b3a1837138, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:53:59,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:59,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:53:59,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:59,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:59,134 INFO [StoreOpener-4e83904c81c27c815abba8b3a1837138-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:59,135 DEBUG [StoreOpener-4e83904c81c27c815abba8b3a1837138-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1 2023-02-10 07:53:59,135 DEBUG [StoreOpener-4e83904c81c27c815abba8b3a1837138-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1 2023-02-10 07:53:59,136 INFO [StoreOpener-4e83904c81c27c815abba8b3a1837138-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e83904c81c27c815abba8b3a1837138 columnFamilyName family1 2023-02-10 07:53:59,138 INFO [StoreOpener-4e83904c81c27c815abba8b3a1837138-1] regionserver.HStore(310): Store=4e83904c81c27c815abba8b3a1837138/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:53:59,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:59,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:59,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4e83904c81c27c815abba8b3a1837138 2023-02-10 07:53:59,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:53:59,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4e83904c81c27c815abba8b3a1837138; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59718926, jitterRate=-0.11011865735054016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:53:59,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4e83904c81c27c815abba8b3a1837138: Running coprocessor pre-open hook at 1676015639133Writing region info on filesystem at 1676015639133Initializing all the Stores at 1676015639134 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676015639134Cleaning up temporary data from old regions at 1676015639140 (+6 ms)Cleaning up detritus from prior splits at 1676015639140Running coprocessor post-open hooks at 1676015639145 (+5 ms)Region opened successfully at 1676015639145 2023-02-10 07:53:59,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138., pid=21, masterSystemTime=1676015639128 2023-02-10 07:53:59,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:53:59,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:53:59,148 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4e83904c81c27c815abba8b3a1837138, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:53:59,148 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676015639148"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015639148"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015639148"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015639148"}]},"ts":"1676015639148"} 2023-02-10 07:53:59,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-10 07:53:59,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 4e83904c81c27c815abba8b3a1837138, server=jenkins-hbase4.apache.org,36907,1676015618909 in 174 msec 2023-02-10 07:53:59,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-10 07:53:59,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=4e83904c81c27c815abba8b3a1837138, ASSIGN in 331 msec 2023-02-10 07:53:59,155 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:53:59,155 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015639155"}]},"ts":"1676015639155"} 2023-02-10 07:53:59,157 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-10 07:53:59,159 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:53:59,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1780 sec 2023-02-10 07:54:00,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-10 07:54:00,092 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-10 07:54:00,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:00,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,137 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:00,137 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:00,138 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:00,138 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:00,139 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,139 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,140 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,140 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:00,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:00,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:00,140 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,140 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:00,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:00,143 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:00,143 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:00,143 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:00,143 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:00,143 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-10 07:54:00,175 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113049878de64c9a492e9caa048605d79f32 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113049878de64c9a492e9caa048605d79f32 2023-02-10 07:54:00,580 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/ab41250a1fd54dacbc74d69ac14bf261 2023-02-10 07:54:00,587 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/ab41250a1fd54dacbc74d69ac14bf261 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/ab41250a1fd54dacbc74d69ac14bf261 2023-02-10 07:54:00,592 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/ab41250a1fd54dacbc74d69ac14bf261, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-10 07:54:00,594 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 450ms, sequenceid=5, compaction requested=false 2023-02-10 07:54:00,594 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:00,594 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:00,595 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:00,595 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:00,596 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,596 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:00,597 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,597 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:00,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:00,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:00,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74b5a7b9[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:00,599 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:00,599 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,601 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,601 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:00,601 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:00,601 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:00,602 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,602 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:00,603 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:00,603 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,603 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:00,604 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:00,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:00,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:00,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:00,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:00,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:00,607 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:00,607 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:00,607 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:00,607 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,607 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:00,609 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,609 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:00,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,609 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:00,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:00,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:00,609 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,611 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:00,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,613 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,613 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:00,613 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:00,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:00,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:00,613 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:00,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:00,613 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:00,613 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:00,614 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:00,614 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,615 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,615 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:00,615 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,615 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:00,715 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:00,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:00,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:00,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:00,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,725 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:00,725 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:00,725 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:00,726 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:00,726 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,726 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,732 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:00,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:00,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:00,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:00,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:00,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:00,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,733 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,733 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:00,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:00,733 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:00,733 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:00,734 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:00,734 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:00,734 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:00,734 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:00,734 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:00,734 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-10 07:54:00,752 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ff513ad6d106472d8b9275da9cac1757 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ff513ad6d106472d8b9275da9cac1757 2023-02-10 07:54:01,160 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/fb2ab5f05b004d1da02273758eb84097 2023-02-10 07:54:01,167 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/fb2ab5f05b004d1da02273758eb84097 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/fb2ab5f05b004d1da02273758eb84097 2023-02-10 07:54:01,172 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/fb2ab5f05b004d1da02273758eb84097, entries=1, sequenceid=9, filesize=5.0 K 2023-02-10 07:54:01,173 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 439ms, sequenceid=9, compaction requested=false 2023-02-10 07:54:01,174 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:01,174 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:01,174 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:01,176 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,176 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,176 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:01,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:01,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15b62a3a[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:01,178 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:01,178 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,179 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,179 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:01,179 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:01,179 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:01,179 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,179 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:01,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:01,181 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:01,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:01,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:01,184 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:01,184 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:01,184 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:01,184 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,184 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:01,190 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,190 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,190 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:01,191 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:01,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,199 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:01,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:54:01,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:01,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:01,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,208 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:01,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:01,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,209 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:01,209 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,309 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:01,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:01,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:01,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:01,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,318 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:01,318 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:01,319 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:01,319 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:01,319 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,319 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,321 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:01,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:01,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:01,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:01,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:01,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,322 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,323 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:01,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,323 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:01,323 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:01,323 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:01,326 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:01,326 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:01,326 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:01,326 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:01,326 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:01,342 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ec5b095bde764974ae6fc540471a18ce to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ec5b095bde764974ae6fc540471a18ce 2023-02-10 07:54:01,351 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/3c11ea96c34a460093ae2876066993a3 2023-02-10 07:54:01,358 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/3c11ea96c34a460093ae2876066993a3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/3c11ea96c34a460093ae2876066993a3 2023-02-10 07:54:01,364 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/3c11ea96c34a460093ae2876066993a3, entries=1, sequenceid=13, filesize=4.9 K 2023-02-10 07:54:01,365 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 39ms, sequenceid=13, compaction requested=true 2023-02-10 07:54:01,366 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:01,366 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:01,367 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,367 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,368 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:01,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:01,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a1fe156[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:01,370 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:01,370 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,372 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,372 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:01,372 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,372 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:01,372 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:01,372 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:01,373 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:01,373 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,373 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:01,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,374 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:01,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:01,378 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:01,378 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:01,378 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:01,378 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,378 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:01,379 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,379 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,379 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:01,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:01,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:01,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,381 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,383 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:01,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:01,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:01,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:01,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:01,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:01,386 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:01,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,387 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:01,387 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:01,387 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:01,487 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:01,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:01,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:01,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:01,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,497 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:01,497 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:01,497 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:01,497 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:01,498 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,498 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,499 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:01,499 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:01,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:01,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,500 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,500 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:01,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:01,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,501 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,501 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:01,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,501 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:01,501 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:01,502 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:01,503 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:01,503 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:01,503 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:01,520 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052c3c2540f46c45d8978d9fa0ab1c5498 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512052c3c2540f46c45d8978d9fa0ab1c5498 2023-02-10 07:54:01,927 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/d9be260fbec3484798124102b7d70f83 2023-02-10 07:54:01,934 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/d9be260fbec3484798124102b7d70f83 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d9be260fbec3484798124102b7d70f83 2023-02-10 07:54:01,940 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d9be260fbec3484798124102b7d70f83, entries=1, sequenceid=17, filesize=4.9 K 2023-02-10 07:54:01,941 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 438ms, sequenceid=17, compaction requested=true 2023-02-10 07:54:01,941 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:01,941 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:01,941 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:01,941 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:01,941 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,941 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:01,941 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:01,943 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,943 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,943 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,943 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:01,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:01,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6348b289[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:01,945 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:01,945 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,947 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,947 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:01,947 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:01,947 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,948 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:01,948 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:01,949 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:01,949 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:01,949 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,949 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:01,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:01,952 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:01,952 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:01,952 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:01,952 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,952 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:01,954 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,954 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,954 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:01,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:01,955 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,956 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,958 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,958 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,958 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,958 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:01,958 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,958 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:01,958 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,959 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:01,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:01,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:01,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:01,959 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:01,959 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:01,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:01,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:54:01,960 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:01,960 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:01,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:01,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:02,060 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:02,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:02,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:02,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:02,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,068 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:02,068 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:02,068 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:02,068 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:02,069 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,069 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,070 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,070 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:02,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:02,070 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,070 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,071 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,071 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:02,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:02,072 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:02,072 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:02,073 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:02,073 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:02,153 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:54:02,495 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228cb67fc6855024d3cad155dfd18ebf1f3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228cb67fc6855024d3cad155dfd18ebf1f3 2023-02-10 07:54:02,902 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/a70c38b0a89949c2a036a2ca7f8d3ce8 2023-02-10 07:54:02,910 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/a70c38b0a89949c2a036a2ca7f8d3ce8 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a70c38b0a89949c2a036a2ca7f8d3ce8 2023-02-10 07:54:02,917 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a70c38b0a89949c2a036a2ca7f8d3ce8, entries=1, sequenceid=21, filesize=4.9 K 2023-02-10 07:54:02,918 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 845ms, sequenceid=21, compaction requested=true 2023-02-10 07:54:02,918 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:02,918 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:02,918 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:02,918 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:02,918 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,919 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:02,919 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:02,922 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,922 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:02,922 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:02,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:02,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:02,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:02,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a194936[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:02,924 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:02,924 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,926 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:02,926 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,926 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:02,927 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:02,927 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,927 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:02,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:02,927 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:02,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:02,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:02,931 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:02,931 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:02,931 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:02,931 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,931 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:02,936 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,936 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,936 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:02,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,937 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:02,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:02,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,938 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:02,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,941 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:02,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:02,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:02,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:02,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:02,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:54:02,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:02,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:02,942 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:02,943 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:03,043 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:03,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:03,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:03,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:03,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,052 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:03,052 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:03,053 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:03,053 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:03,053 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,053 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,055 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,055 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:03,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:03,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:03,055 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,055 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:03,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:03,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,056 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,060 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:03,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,060 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:03,060 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:03,061 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:03,068 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:03,068 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:03,068 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:03,068 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:03,068 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:03,102 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231938b43af584744a4afb7812cab4f5b86 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231938b43af584744a4afb7812cab4f5b86 2023-02-10 07:54:03,119 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/4a27cf4811524ba1b78647e722fef2b0 2023-02-10 07:54:03,131 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/4a27cf4811524ba1b78647e722fef2b0 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/4a27cf4811524ba1b78647e722fef2b0 2023-02-10 07:54:03,139 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/4a27cf4811524ba1b78647e722fef2b0, entries=1, sequenceid=25, filesize=4.9 K 2023-02-10 07:54:03,141 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 73ms, sequenceid=25, compaction requested=true 2023-02-10 07:54:03,141 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:03,141 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:03,141 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:03,141 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:03,141 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,141 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:03,141 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:03,143 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,143 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:03,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:03,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:03,144 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,144 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:03,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:03,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:03,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:03,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e5a53b5[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:03,146 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:03,146 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,148 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,149 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:03,149 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:03,149 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:03,151 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,151 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:03,154 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:03,154 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,154 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:03,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:03,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:03,154 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:03,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:03,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:03,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:03,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:03,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:03,158 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:03,158 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:03,158 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:03,158 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,158 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:03,161 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,161 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:03,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:03,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:03,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,169 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:03,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:03,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:03,170 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:03,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,172 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:03,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,178 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:03,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:03,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:03,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:03,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:03,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:03,179 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:54:03,180 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:03,179 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:03,180 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:03,180 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,180 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,180 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:03,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:03,280 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:03,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:03,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:03,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:03,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,294 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:03,294 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:03,294 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:03,294 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:03,295 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,295 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,297 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:03,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:03,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:03,298 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:03,298 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:03,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:03,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,299 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,303 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:03,303 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:03,303 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:03,303 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:03,303 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:03,308 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:03,308 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:03,308 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:03,308 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:03,308 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:03,745 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f3763e3abaa2489eb9a5c34252f0cd0d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f3763e3abaa2489eb9a5c34252f0cd0d 2023-02-10 07:54:04,151 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/a551ffc7a8ea4a198e29bf0ba5370f9f 2023-02-10 07:54:04,158 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/a551ffc7a8ea4a198e29bf0ba5370f9f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a551ffc7a8ea4a198e29bf0ba5370f9f 2023-02-10 07:54:04,163 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a551ffc7a8ea4a198e29bf0ba5370f9f, entries=1, sequenceid=29, filesize=4.9 K 2023-02-10 07:54:04,164 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 856ms, sequenceid=29, compaction requested=true 2023-02-10 07:54:04,165 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:04,165 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:04,165 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:04,165 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:04,165 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,165 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:04,165 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:04,167 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,167 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:04,167 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,167 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:04,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:04,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b7a0479[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:04,168 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:04,168 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,170 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,170 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:04,170 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:04,170 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:04,170 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,170 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:04,171 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,171 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:04,171 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:04,171 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:04,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:04,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:04,174 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:04,174 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:04,174 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:04,174 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,174 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:04,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:04,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:04,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:04,177 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,178 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,181 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,181 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:04,181 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:04,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:04,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:04,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:04,181 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:04,181 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:54:04,181 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:04,182 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:04,181 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,182 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:04,182 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:04,182 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,182 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,282 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:04,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:04,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:04,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:04,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,291 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:04,291 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:04,292 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:04,292 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:04,292 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,292 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,341 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:04,341 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:04,341 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:04,341 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:04,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:04,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,342 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,342 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:04,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:04,342 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:04,342 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:04,343 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:04,343 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:04,343 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:04,343 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:04,343 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:04,343 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:04,760 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ced40f34504f4d64b170fbc17b09c722 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103ced40f34504f4d64b170fbc17b09c722 2023-02-10 07:54:05,166 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/d40081b962ce4af291b91d02452d48eb 2023-02-10 07:54:05,173 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/d40081b962ce4af291b91d02452d48eb as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d40081b962ce4af291b91d02452d48eb 2023-02-10 07:54:05,180 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d40081b962ce4af291b91d02452d48eb, entries=1, sequenceid=33, filesize=4.9 K 2023-02-10 07:54:05,181 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 838ms, sequenceid=33, compaction requested=true 2023-02-10 07:54:05,181 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:05,181 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:05,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:05,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:05,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:05,181 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:05,183 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,183 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:05,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:05,183 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,183 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:05,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:05,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:05,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d003765[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:05,185 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:05,185 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,187 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,187 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:05,187 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:05,187 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,187 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:05,187 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:05,206 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,206 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:05,206 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:05,207 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:05,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:05,210 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:05,210 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:05,210 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:05,210 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,210 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:05,211 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,211 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:05,211 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:05,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:05,212 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,213 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:05,218 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:05,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:05,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:05,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:05,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:05,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:05,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:05,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,219 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:05,219 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:05,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,319 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:05,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:05,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:05,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:05,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,328 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:05,328 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:05,328 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:05,329 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:05,329 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,329 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,330 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:05,330 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:05,331 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:05,331 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,332 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,332 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:05,332 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:05,332 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:05,332 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:05,336 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:05,336 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:05,336 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:05,336 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:05,337 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:05,756 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b8f3ebe34e3047a19ededadbc1c3626f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907b8f3ebe34e3047a19ededadbc1c3626f 2023-02-10 07:54:06,163 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/41e4584ad06e42188d8604559757c61e 2023-02-10 07:54:06,169 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/41e4584ad06e42188d8604559757c61e as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/41e4584ad06e42188d8604559757c61e 2023-02-10 07:54:06,175 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/41e4584ad06e42188d8604559757c61e, entries=1, sequenceid=37, filesize=4.9 K 2023-02-10 07:54:06,177 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 840ms, sequenceid=37, compaction requested=true 2023-02-10 07:54:06,177 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:06,177 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:06,180 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,180 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:06,180 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,180 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:06,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:06,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7da09f0a[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:06,182 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:06,182 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,184 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:06,184 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:06,184 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,184 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:06,185 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:06,186 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:06,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:06,189 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:06,189 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:06,189 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:06,189 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,189 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:06,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:06,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,192 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:06,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:06,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,194 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,197 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,197 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:06,197 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,197 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:06,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:06,197 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:06,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:06,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:06,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:06,197 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,198 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,198 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:06,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:06,198 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,198 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:06,198 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:06,198 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,298 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:06,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:06,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:06,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:06,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,307 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:06,307 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:06,308 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:54:06,308 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:06,309 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,309 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,311 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:06,311 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:06,311 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,311 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:06,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:06,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,312 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,312 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:54:06,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:06,312 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:54:06,313 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:06,314 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:54:06,314 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:06,314 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:06,314 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:06,314 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. started... 2023-02-10 07:54:06,314 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4e83904c81c27c815abba8b3a1837138 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:06,736 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204be838eef15d4feda84ff149e77b1b61 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511204be838eef15d4feda84ff149e77b1b61 2023-02-10 07:54:07,143 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/dcbd638399484afab9970beb4397a2e2 2023-02-10 07:54:07,149 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/dcbd638399484afab9970beb4397a2e2 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/dcbd638399484afab9970beb4397a2e2 2023-02-10 07:54:07,154 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/dcbd638399484afab9970beb4397a2e2, entries=1, sequenceid=41, filesize=4.9 K 2023-02-10 07:54:07,155 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e83904c81c27c815abba8b3a1837138 in 841ms, sequenceid=41, compaction requested=true 2023-02-10 07:54:07,156 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:07,156 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:07,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:07,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:07,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:54:07,156 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:54:07,158 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,158 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:07,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:07,158 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,158 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@312bbcf0[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:07,160 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:07,160 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,162 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,162 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:07,162 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:54:07,162 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,162 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:07,162 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:07,164 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,164 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:54:07,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:07,164 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:07,165 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:54:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:07,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:07,168 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:54:07,168 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:07,168 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:07,168 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,168 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:07,170 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,170 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,170 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:07,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:07,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:07,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,171 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:07,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,172 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:07,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:07,174 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:07,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:07,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:07,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-10 07:54:07,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:07,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:54:07,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:07,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:07,176 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:07,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,176 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:07,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:07,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:07,276 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:07,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:07,279 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-10 07:54:07,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:07,282 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:07,283 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016247283 2023-02-10 07:54:07,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:07,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:54:07,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-10 07:54:07,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:54:07,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x4e73c5ee to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:54:07,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b7781c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:54:07,291 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:54:08,129 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103bc94c3ef00ba4d688e967b83db486b9f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103bc94c3ef00ba4d688e967b83db486b9f 2023-02-10 07:54:08,131 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:54:08,144 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:54:08,145 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:54:08,153 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:54:08,154 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51232, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:54:08,165 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cf029f0949654b53b2c4bbc3c5250e4b first=Optional[r5] last=Optional[r6] 2023-02-10 07:54:08,166 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cf029f0949654b53b2c4bbc3c5250e4b}] 2023-02-10 07:54:08,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cf029f0949654b53b2c4bbc3c5250e4b for inclusion in 4e83904c81c27c815abba8b3a1837138/family1 2023-02-10 07:54:08,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-10 07:54:08,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:08,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:08,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cf029f0949654b53b2c4bbc3c5250e4b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__138n5chd4un2aeobd5qolctoefjv3e1rqfjrgsohh16fucb5jlud4k7m7m2mjuj7/family1/cf029f0949654b53b2c4bbc3c5250e4b 2023-02-10 07:54:08,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__138n5chd4un2aeobd5qolctoefjv3e1rqfjrgsohh16fucb5jlud4k7m7m2mjuj7/family1/cf029f0949654b53b2c4bbc3c5250e4b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_ 2023-02-10 07:54:08,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__138n5chd4un2aeobd5qolctoefjv3e1rqfjrgsohh16fucb5jlud4k7m7m2mjuj7/family1/cf029f0949654b53b2c4bbc3c5250e4b into 4e83904c81c27c815abba8b3a1837138/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_ - updating store file list. 2023-02-10 07:54:08,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_ into 4e83904c81c27c815abba8b3a1837138/family1 2023-02-10 07:54:08,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__138n5chd4un2aeobd5qolctoefjv3e1rqfjrgsohh16fucb5jlud4k7m7m2mjuj7/family1/cf029f0949654b53b2c4bbc3c5250e4b into 4e83904c81c27c815abba8b3a1837138/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_) 2023-02-10 07:54:08,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__138n5chd4un2aeobd5qolctoefjv3e1rqfjrgsohh16fucb5jlud4k7m7m2mjuj7/family1/cf029f0949654b53b2c4bbc3c5250e4b 2023-02-10 07:54:08,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-10 07:54:08,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-10 07:54:08,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 4e83904c81c27c815abba8b3a1837138/family1 is initiating minor compaction 2023-02-10 07:54:08,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3ee10b9d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:08,191 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4e83904c81c27c815abba8b3a1837138/family1 in testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:08,191 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/fb2ab5f05b004d1da02273758eb84097, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/3c11ea96c34a460093ae2876066993a3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d9be260fbec3484798124102b7d70f83, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a70c38b0a89949c2a036a2ca7f8d3ce8, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/4a27cf4811524ba1b78647e722fef2b0, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a551ffc7a8ea4a198e29bf0ba5370f9f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d40081b962ce4af291b91d02452d48eb, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/41e4584ad06e42188d8604559757c61e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/dcbd638399484afab9970beb4397a2e2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp, totalSize=49.7 K 2023-02-10 07:54:08,191 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting fb2ab5f05b004d1da02273758eb84097, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-10 07:54:08,191 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 3c11ea96c34a460093ae2876066993a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-10 07:54:08,191 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting d9be260fbec3484798124102b7d70f83, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-10 07:54:08,192 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting a70c38b0a89949c2a036a2ca7f8d3ce8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-10 07:54:08,192 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 4a27cf4811524ba1b78647e722fef2b0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-10 07:54:08,192 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting a551ffc7a8ea4a198e29bf0ba5370f9f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-10 07:54:08,192 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting d40081b962ce4af291b91d02452d48eb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-10 07:54:08,192 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 41e4584ad06e42188d8604559757c61e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-10 07:54:08,192 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting dcbd638399484afab9970beb4397a2e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-10 07:54:08,192 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-10 07:54:08,194 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:54:08,195 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:08,197 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f3763e3abaa2489eb9a5c34252f0cd0d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f3763e3abaa2489eb9a5c34252f0cd0d 2023-02-10 07:54:08,199 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103ced40f34504f4d64b170fbc17b09c722 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103ced40f34504f4d64b170fbc17b09c722 2023-02-10 07:54:08,199 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-10 07:54:08,199 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-10 07:54:08,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:54:08,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:54:08,242 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4e83904c81c27c815abba8b3a1837138#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:08,276 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/eb6a2eaf032042208d1f70dc1e2556ac as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/eb6a2eaf032042208d1f70dc1e2556ac 2023-02-10 07:54:08,278 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319fd3cc5e391d42ad8b4c8d2bcaad91af to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512319fd3cc5e391d42ad8b4c8d2bcaad91af 2023-02-10 07:54:08,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:54:08,283 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4e83904c81c27c815abba8b3a1837138/family1 of 4e83904c81c27c815abba8b3a1837138 into eb6a2eaf032042208d1f70dc1e2556ac(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:54:08,284 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:08,284 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676015648191; duration=0sec 2023-02-10 07:54:08,284 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:08,313 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4b3d978ddb1e4ce993a4294250aa460f first=Optional[r1] last=Optional[r4] 2023-02-10 07:54:08,314 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4b3d978ddb1e4ce993a4294250aa460f}] 2023-02-10 07:54:08,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4b3d978ddb1e4ce993a4294250aa460f for inclusion in 4e83904c81c27c815abba8b3a1837138/family1 2023-02-10 07:54:08,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-10 07:54:08,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:08,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:08,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/4b3d978ddb1e4ce993a4294250aa460f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__aat49uj1t0100i9241h0aamdt7113fianl9n9tdpbcplohcs9kllbq2iuo3jdh9r/family1/4b3d978ddb1e4ce993a4294250aa460f 2023-02-10 07:54:08,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__aat49uj1t0100i9241h0aamdt7113fianl9n9tdpbcplohcs9kllbq2iuo3jdh9r/family1/4b3d978ddb1e4ce993a4294250aa460f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/83f70b926e364f29a795c0d1a114ed98_SeqId_47_ 2023-02-10 07:54:08,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__aat49uj1t0100i9241h0aamdt7113fianl9n9tdpbcplohcs9kllbq2iuo3jdh9r/family1/4b3d978ddb1e4ce993a4294250aa460f into 4e83904c81c27c815abba8b3a1837138/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/83f70b926e364f29a795c0d1a114ed98_SeqId_47_ - updating store file list. 2023-02-10 07:54:08,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/83f70b926e364f29a795c0d1a114ed98_SeqId_47_ into 4e83904c81c27c815abba8b3a1837138/family1 2023-02-10 07:54:08,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__aat49uj1t0100i9241h0aamdt7113fianl9n9tdpbcplohcs9kllbq2iuo3jdh9r/family1/4b3d978ddb1e4ce993a4294250aa460f into 4e83904c81c27c815abba8b3a1837138/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/83f70b926e364f29a795c0d1a114ed98_SeqId_47_) 2023-02-10 07:54:08,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__aat49uj1t0100i9241h0aamdt7113fianl9n9tdpbcplohcs9kllbq2iuo3jdh9r/family1/4b3d978ddb1e4ce993a4294250aa460f 2023-02-10 07:54:08,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-10 07:54:08,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-10 07:54:08,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 4e83904c81c27c815abba8b3a1837138/family1 is initiating minor compaction (all files) 2023-02-10 07:54:08,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3696e6fb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:08,336 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4e83904c81c27c815abba8b3a1837138/family1 in testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:54:08,336 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/ab41250a1fd54dacbc74d69ac14bf261, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/eb6a2eaf032042208d1f70dc1e2556ac, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/83f70b926e364f29a795c0d1a114ed98_SeqId_47_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp, totalSize=178.1 K 2023-02-10 07:54:08,337 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting ab41250a1fd54dacbc74d69ac14bf261, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842896 2023-02-10 07:54:08,338 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting eb6a2eaf032042208d1f70dc1e2556ac, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242896 2023-02-10 07:54:08,339 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 83f70b926e364f29a795c0d1a114ed98_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242896 2023-02-10 07:54:08,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:54:08,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:08,342 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ec5b095bde764974ae6fc540471a18ce to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ec5b095bde764974ae6fc540471a18ce 2023-02-10 07:54:08,344 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512052c3c2540f46c45d8978d9fa0ab1c5498 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512052c3c2540f46c45d8978d9fa0ab1c5498 2023-02-10 07:54:08,346 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228cb67fc6855024d3cad155dfd18ebf1f3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228cb67fc6855024d3cad155dfd18ebf1f3 2023-02-10 07:54:08,348 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231938b43af584744a4afb7812cab4f5b86 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231938b43af584744a4afb7812cab4f5b86 2023-02-10 07:54:08,348 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-10 07:54:08,348 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-10 07:54:08,348 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:54:08,349 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:54:08,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/fb2ab5f05b004d1da02273758eb84097, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/3c11ea96c34a460093ae2876066993a3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d9be260fbec3484798124102b7d70f83, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a70c38b0a89949c2a036a2ca7f8d3ce8, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/4a27cf4811524ba1b78647e722fef2b0, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a551ffc7a8ea4a198e29bf0ba5370f9f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d40081b962ce4af291b91d02452d48eb, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/41e4584ad06e42188d8604559757c61e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/dcbd638399484afab9970beb4397a2e2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_] to archive 2023-02-10 07:54:08,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:08,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/fb2ab5f05b004d1da02273758eb84097 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/fb2ab5f05b004d1da02273758eb84097 2023-02-10 07:54:08,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/3c11ea96c34a460093ae2876066993a3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/3c11ea96c34a460093ae2876066993a3 2023-02-10 07:54:08,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d9be260fbec3484798124102b7d70f83 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d9be260fbec3484798124102b7d70f83 2023-02-10 07:54:08,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a70c38b0a89949c2a036a2ca7f8d3ce8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a70c38b0a89949c2a036a2ca7f8d3ce8 2023-02-10 07:54:08,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/4a27cf4811524ba1b78647e722fef2b0 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/4a27cf4811524ba1b78647e722fef2b0 2023-02-10 07:54:08,411 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4e83904c81c27c815abba8b3a1837138#family1#compaction#23 average throughput is 4.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:08,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a551ffc7a8ea4a198e29bf0ba5370f9f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/a551ffc7a8ea4a198e29bf0ba5370f9f 2023-02-10 07:54:08,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d40081b962ce4af291b91d02452d48eb to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/d40081b962ce4af291b91d02452d48eb 2023-02-10 07:54:08,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/41e4584ad06e42188d8604559757c61e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/41e4584ad06e42188d8604559757c61e 2023-02-10 07:54:08,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/dcbd638399484afab9970beb4397a2e2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/dcbd638399484afab9970beb4397a2e2 2023-02-10 07:54:08,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/b2591c9e0b0c4c8e8820e9d995d6d63f_SeqId_44_ 2023-02-10 07:54:08,467 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301e9c079756d94fd1a83ca175a4da385b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511301e9c079756d94fd1a83ca175a4da385b 2023-02-10 07:54:08,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:54:08,506 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/369c2f8119b5422a85513c4a186866ac first=Optional[r00] last=Optional[r8] 2023-02-10 07:54:08,507 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/369c2f8119b5422a85513c4a186866ac}] 2023-02-10 07:54:08,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/369c2f8119b5422a85513c4a186866ac for inclusion in 4e83904c81c27c815abba8b3a1837138/family1 2023-02-10 07:54:08,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-10 07:54:08,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:08,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:08,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/369c2f8119b5422a85513c4a186866ac to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__angf7bje6fo77j331ai0os04065ge16htcmedt4ng2637pqh4fe1c2bjvdt1lmfh/family1/369c2f8119b5422a85513c4a186866ac 2023-02-10 07:54:08,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__angf7bje6fo77j331ai0os04065ge16htcmedt4ng2637pqh4fe1c2bjvdt1lmfh/family1/369c2f8119b5422a85513c4a186866ac as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/da21024b6f824af89a81f24e74773d90_SeqId_49_ 2023-02-10 07:54:08,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__angf7bje6fo77j331ai0os04065ge16htcmedt4ng2637pqh4fe1c2bjvdt1lmfh/family1/369c2f8119b5422a85513c4a186866ac into 4e83904c81c27c815abba8b3a1837138/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/da21024b6f824af89a81f24e74773d90_SeqId_49_ - updating store file list. 2023-02-10 07:54:08,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/da21024b6f824af89a81f24e74773d90_SeqId_49_ into 4e83904c81c27c815abba8b3a1837138/family1 2023-02-10 07:54:08,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__angf7bje6fo77j331ai0os04065ge16htcmedt4ng2637pqh4fe1c2bjvdt1lmfh/family1/369c2f8119b5422a85513c4a186866ac into 4e83904c81c27c815abba8b3a1837138/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/da21024b6f824af89a81f24e74773d90_SeqId_49_) 2023-02-10 07:54:08,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithMonthlyPolicy__angf7bje6fo77j331ai0os04065ge16htcmedt4ng2637pqh4fe1c2bjvdt1lmfh/family1/369c2f8119b5422a85513c4a186866ac 2023-02-10 07:54:08,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:54:08,531 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:08,534 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511204be838eef15d4feda84ff149e77b1b61 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511204be838eef15d4feda84ff149e77b1b61 2023-02-10 07:54:08,535 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ff513ad6d106472d8b9275da9cac1757 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ff513ad6d106472d8b9275da9cac1757 2023-02-10 07:54:08,537 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113049878de64c9a492e9caa048605d79f32 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113049878de64c9a492e9caa048605d79f32 2023-02-10 07:54:08,537 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-10 07:54:08,537 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-10 07:54:08,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:54:08,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:54:08,538 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:54:08,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:54:08,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:08,540 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:08,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.2600 sec 2023-02-10 07:54:08,665 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=264 (was 247) Potentially hanging thread: hconnection-0x6ceda0e2-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48716 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48744 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48770 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48836 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48890 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f5e6fb2-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48772 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48786 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ceda0e2-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ceda0e2-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48792 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48798 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48710 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-2131529517-172.31.14.131-1676015614786:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: Thread-478 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48688 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ceda0e2-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x4e73c5ee-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/edd92930fd6a4525aa4bc7fbbba2c653 block BP-2131529517-172.31.14.131-1676015614786:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x4e73c5ee-SendThread(127.0.0.1:54857) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48760 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1260592341_15 at /127.0.0.1:48646 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-2131529517-172.31.14.131-1676015614786:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:54857@0x4e73c5ee sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1012379153.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48824 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48758 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ceda0e2-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1260592341_15 at /127.0.0.1:48696 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48626 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ceda0e2-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cf22e79dda164d92b820ca3968dd18cd_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48816 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6ceda0e2-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1260592341_15 at /127.0.0.1:48876 [Receiving block BP-2131529517-172.31.14.131-1676015614786:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-396266528_15 at /127.0.0.1:48736 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=624 (was 586) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=284 (was 326), ProcessCount=168 (was 168), AvailableMemoryMB=3794 (was 4221) 2023-02-10 07:54:08,679 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=264, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=326, ProcessCount=168, AvailableMemoryMB=3792 2023-02-10 07:54:08,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-10 07:54:08,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:08,686 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:54:08,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-10 07:54:08,687 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:54:08,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-10 07:54:08,692 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:08,693 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e empty. 2023-02-10 07:54:08,694 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:08,694 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-10 07:54:08,707 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-10 07:54:08,709 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => ec0407a8776641eb4bea5746b0db281e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:54:08,716 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:08,716 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing ec0407a8776641eb4bea5746b0db281e, disabling compactions & flushes 2023-02-10 07:54:08,716 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:08,716 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:08,716 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. after waiting 0 ms 2023-02-10 07:54:08,716 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:08,717 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:08,717 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for ec0407a8776641eb4bea5746b0db281e: Waiting for close lock at 1676015648716Disabling compacts and flushes for region at 1676015648716Disabling writes for close at 1676015648716Writing region close event to WAL at 1676015648717 (+1 ms)Closed at 1676015648717 2023-02-10 07:54:08,720 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:54:08,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676015648721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015648721"}]},"ts":"1676015648721"} 2023-02-10 07:54:08,724 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:54:08,725 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:54:08,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015648725"}]},"ts":"1676015648725"} 2023-02-10 07:54:08,727 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-10 07:54:08,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=ec0407a8776641eb4bea5746b0db281e, ASSIGN}] 2023-02-10 07:54:08,736 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=ec0407a8776641eb4bea5746b0db281e, ASSIGN 2023-02-10 07:54:08,737 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=ec0407a8776641eb4bea5746b0db281e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:54:08,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-10 07:54:08,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=ec0407a8776641eb4bea5746b0db281e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:08,888 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676015648888"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015648888"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015648888"}]},"ts":"1676015648888"} 2023-02-10 07:54:08,890 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure ec0407a8776641eb4bea5746b0db281e, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:08,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-10 07:54:09,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:09,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ec0407a8776641eb4bea5746b0db281e, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:54:09,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:09,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:09,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:09,047 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:09,049 INFO [StoreOpener-ec0407a8776641eb4bea5746b0db281e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:09,050 DEBUG [StoreOpener-ec0407a8776641eb4bea5746b0db281e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1 2023-02-10 07:54:09,051 DEBUG [StoreOpener-ec0407a8776641eb4bea5746b0db281e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1 2023-02-10 07:54:09,051 INFO [StoreOpener-ec0407a8776641eb4bea5746b0db281e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec0407a8776641eb4bea5746b0db281e columnFamilyName family1 2023-02-10 07:54:09,053 INFO [StoreOpener-ec0407a8776641eb4bea5746b0db281e-1] regionserver.HStore(310): Store=ec0407a8776641eb4bea5746b0db281e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:09,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:09,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:09,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:54:09,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:54:09,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ec0407a8776641eb4bea5746b0db281e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61439129, jitterRate=-0.08448563516139984}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:54:09,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ec0407a8776641eb4bea5746b0db281e: Running coprocessor pre-open hook at 1676015649047Writing region info on filesystem at 1676015649047Initializing all the Stores at 1676015649048 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676015649049 (+1 ms)Cleaning up temporary data from old regions at 1676015649055 (+6 ms)Cleaning up detritus from prior splits at 1676015649055Running coprocessor post-open hooks at 1676015649060 (+5 ms)Region opened successfully at 1676015649060 2023-02-10 07:54:09,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e., pid=25, masterSystemTime=1676015649042 2023-02-10 07:54:09,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:09,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:09,064 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=ec0407a8776641eb4bea5746b0db281e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,064 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676015649064"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015649064"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015649064"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015649064"}]},"ts":"1676015649064"} 2023-02-10 07:54:09,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-10 07:54:09,068 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure ec0407a8776641eb4bea5746b0db281e, server=jenkins-hbase4.apache.org,36907,1676015618909 in 176 msec 2023-02-10 07:54:09,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-10 07:54:09,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=ec0407a8776641eb4bea5746b0db281e, ASSIGN in 334 msec 2023-02-10 07:54:09,072 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:54:09,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015649072"}]},"ts":"1676015649072"} 2023-02-10 07:54:09,074 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-10 07:54:09,077 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:54:09,079 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 394 msec 2023-02-10 07:54:09,262 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/.tmp/family1/edd92930fd6a4525aa4bc7fbbba2c653 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/edd92930fd6a4525aa4bc7fbbba2c653 2023-02-10 07:54:09,268 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4e83904c81c27c815abba8b3a1837138/family1 of 4e83904c81c27c815abba8b3a1837138 into edd92930fd6a4525aa4bc7fbbba2c653(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:54:09,269 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4e83904c81c27c815abba8b3a1837138: 2023-02-10 07:54:09,269 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676015648336; duration=0sec 2023-02-10 07:54:09,269 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:09,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-10 07:54:09,292 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-10 07:54:09,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:09,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,321 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:09,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:09,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:09,321 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:09,322 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,322 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,324 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:09,324 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:09,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:09,325 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,325 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:09,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:09,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,326 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,326 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:09,326 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:09,326 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:09,327 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:09,327 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:09,327 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:09,327 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:09,328 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-10 07:54:09,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/ab41250a1fd54dacbc74d69ac14bf261, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/eb6a2eaf032042208d1f70dc1e2556ac, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/83f70b926e364f29a795c0d1a114ed98_SeqId_47_] to archive 2023-02-10 07:54:09,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:09,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/ab41250a1fd54dacbc74d69ac14bf261 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/ab41250a1fd54dacbc74d69ac14bf261 2023-02-10 07:54:09,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/eb6a2eaf032042208d1f70dc1e2556ac to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/eb6a2eaf032042208d1f70dc1e2556ac 2023-02-10 07:54:09,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/83f70b926e364f29a795c0d1a114ed98_SeqId_47_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/family1/83f70b926e364f29a795c0d1a114ed98_SeqId_47_ 2023-02-10 07:54:09,366 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c731fc269f234b89a0f47f8c62e63bed to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130c731fc269f234b89a0f47f8c62e63bed 2023-02-10 07:54:09,771 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/0671e9ef865d4d2da776dfda737ec3ff 2023-02-10 07:54:09,777 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/0671e9ef865d4d2da776dfda737ec3ff as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/0671e9ef865d4d2da776dfda737ec3ff 2023-02-10 07:54:09,783 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/0671e9ef865d4d2da776dfda737ec3ff, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-10 07:54:09,784 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 456ms, sequenceid=5, compaction requested=false 2023-02-10 07:54:09,784 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:09,785 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:09,785 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:09,785 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:09,785 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:09,785 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,785 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:09,785 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:09,787 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,787 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:09,787 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,787 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:09,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:09,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:09,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:09,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:09,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a093f60[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:09,789 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:09,789 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:09,790 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,790 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:09,790 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:09,791 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,791 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:09,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:09,791 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:09,792 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:09,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:09,794 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:09,794 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:09,794 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:09,794 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,794 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:09,801 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:09,801 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,801 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:09,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:09,802 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,803 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:09,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,806 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:09,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:09,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:09,807 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:09,807 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:09,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:09,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:09,807 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:09,807 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:09,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:09,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:09,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:09,907 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:09,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:09,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:09,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:09,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,916 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:09,916 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:09,916 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:09,916 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:09,916 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,917 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,918 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:09,918 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:09,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:09,918 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:09,918 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:09,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:09,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,920 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,920 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:09,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:09,920 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:09,920 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:09,920 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:09,920 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:09,920 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:09,920 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:09,920 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:09,921 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-10 07:54:10,336 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283bd501e81e244acdb695a2a0d64a8403 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511283bd501e81e244acdb695a2a0d64a8403 2023-02-10 07:54:10,372 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:54:10,373 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e73c5ee to 127.0.0.1:54857 2023-02-10 07:54:10,373 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:54:10,380 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:54:10,380 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22d682cf to 127.0.0.1:54857 2023-02-10 07:54:10,380 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:54:10,380 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:54:10,381 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3244f326 to 127.0.0.1:54857 2023-02-10 07:54:10,381 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:54:10,774 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/12ca3b02bc864854a5f1fe53f5741176 2023-02-10 07:54:10,781 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/12ca3b02bc864854a5f1fe53f5741176 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/12ca3b02bc864854a5f1fe53f5741176 2023-02-10 07:54:10,786 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/12ca3b02bc864854a5f1fe53f5741176, entries=1, sequenceid=9, filesize=5.0 K 2023-02-10 07:54:10,787 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 866ms, sequenceid=9, compaction requested=false 2023-02-10 07:54:10,787 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:10,787 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:10,787 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:10,787 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:10,787 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,787 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:10,787 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:10,789 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,789 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:10,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:10,789 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,789 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:10,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:10,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:10,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:10,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:10,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46be825b[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:10,791 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:10,791 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,792 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,792 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:10,793 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:10,793 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,793 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:10,793 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:10,794 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:10,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:10,797 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:10,797 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:10,797 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:10,797 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,797 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:10,800 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,800 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:10,800 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:10,801 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,802 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,805 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,805 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:10,805 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:10,805 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:10,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:10,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:10,805 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,805 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:10,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,806 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,806 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:10,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:10,806 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:10,906 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:10,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:10,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:10,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:10,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,914 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:10,914 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:10,914 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:10,914 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:10,914 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,914 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,916 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,916 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:10,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:10,916 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:10,916 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:10,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:10,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,917 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,917 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:10,917 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:10,917 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:10,917 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:10,917 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:10,917 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:10,917 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:10,917 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:10,917 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:10,918 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:11,333 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010d5078a0f23a4c54b16406c126eb7e33 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010d5078a0f23a4c54b16406c126eb7e33 2023-02-10 07:54:11,739 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/6fb7b9639ef646138de8c4d27eb84c28 2023-02-10 07:54:11,746 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/6fb7b9639ef646138de8c4d27eb84c28 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/6fb7b9639ef646138de8c4d27eb84c28 2023-02-10 07:54:11,750 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/6fb7b9639ef646138de8c4d27eb84c28, entries=1, sequenceid=13, filesize=4.9 K 2023-02-10 07:54:11,752 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 834ms, sequenceid=13, compaction requested=true 2023-02-10 07:54:11,752 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:11,753 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:11,753 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:11,753 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:11,753 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,753 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:11,753 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:11,754 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,755 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:11,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:11,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:11,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f1f0d49[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:11,756 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:11,756 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,758 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:11,758 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,758 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:11,758 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:11,760 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:11,760 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:11,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:11,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:11,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:11,762 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:11,762 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:11,762 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:11,762 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,762 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:11,767 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,767 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,767 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:11,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:11,767 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:11,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,768 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:11,777 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:11,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:11,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:11,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:11,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:11,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:11,777 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,778 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,778 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,878 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:11,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:11,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:11,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:11,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,884 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:11,884 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:11,884 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:11,884 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:11,885 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,885 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,886 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,886 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:11,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:11,886 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:11,886 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:11,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:11,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,887 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:11,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:11,887 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:11,887 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:11,888 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:11,888 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:11,888 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:11,888 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:11,888 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:11,888 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:12,304 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120535b07515b9344cccb1bb274705561118 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120535b07515b9344cccb1bb274705561118 2023-02-10 07:54:12,712 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/2c1d5577245d46228c6a0c1d8659e766 2023-02-10 07:54:12,719 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/2c1d5577245d46228c6a0c1d8659e766 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/2c1d5577245d46228c6a0c1d8659e766 2023-02-10 07:54:12,724 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/2c1d5577245d46228c6a0c1d8659e766, entries=1, sequenceid=17, filesize=4.9 K 2023-02-10 07:54:12,725 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 837ms, sequenceid=17, compaction requested=true 2023-02-10 07:54:12,726 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:12,726 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:12,726 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:12,728 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,728 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:12,728 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:12,728 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:12,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:12,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:12,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:12,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@533ffa66[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:12,730 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:12,730 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,731 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:12,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:12,734 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:12,734 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:12,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:12,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:12,737 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:12,737 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:12,737 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:12,737 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,737 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:12,738 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,738 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:12,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,739 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:12,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:12,739 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:12,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,742 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:12,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,744 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,744 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,744 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:12,744 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,744 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:12,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:12,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:12,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:12,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:12,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:12,744 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:12,744 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:12,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:12,744 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:12,744 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:12,745 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,745 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,745 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,845 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:12,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:12,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:12,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:12,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,852 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:12,852 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:12,852 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:12,852 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:12,852 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,852 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,854 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,854 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:12,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:12,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:12,854 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:12,854 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:12,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,854 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:12,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,855 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:12,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:12,855 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:12,855 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:12,855 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:12,855 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:12,855 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:12,855 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:12,855 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:12,855 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:12,869 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122875dfe17ffaac492da6d0ff09c59dc85b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122875dfe17ffaac492da6d0ff09c59dc85b 2023-02-10 07:54:13,275 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/97691284d5c540e8a41d20006ad8974f 2023-02-10 07:54:13,281 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/97691284d5c540e8a41d20006ad8974f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/97691284d5c540e8a41d20006ad8974f 2023-02-10 07:54:13,285 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/97691284d5c540e8a41d20006ad8974f, entries=1, sequenceid=21, filesize=4.9 K 2023-02-10 07:54:13,286 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 431ms, sequenceid=21, compaction requested=true 2023-02-10 07:54:13,286 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:13,286 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:13,286 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:13,286 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:13,286 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,287 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:13,287 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:13,291 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,291 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:13,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:13,291 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,291 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:13,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:13,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:13,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:13,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:13,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@504e2d5e[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:13,292 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:13,292 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,293 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:13,294 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,294 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:13,295 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,295 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:13,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:13,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:13,295 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:13,295 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:13,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:13,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:13,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:13,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:13,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:13,297 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:13,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:13,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:13,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,297 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:13,299 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,299 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:13,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:13,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,299 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:13,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:13,300 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:13,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,301 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:13,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:13,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,305 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:13,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:13,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:13,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:13,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:13,306 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,406 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:13,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:13,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:13,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:13,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,413 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:13,413 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:13,413 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:13,413 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:13,413 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,413 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,414 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:13,414 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:13,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:13,415 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,415 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:13,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:13,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,415 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,416 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:13,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,416 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:13,416 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:13,416 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:13,416 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:13,416 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:13,416 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:13,416 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:13,416 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:13,429 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319f4b0f05dc8d4b59846acf4a67a5c69a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319f4b0f05dc8d4b59846acf4a67a5c69a 2023-02-10 07:54:13,835 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/85c3fe666aaf40309f15a9569d71a559 2023-02-10 07:54:13,841 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/85c3fe666aaf40309f15a9569d71a559 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/85c3fe666aaf40309f15a9569d71a559 2023-02-10 07:54:13,845 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/85c3fe666aaf40309f15a9569d71a559, entries=1, sequenceid=25, filesize=4.9 K 2023-02-10 07:54:13,846 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 430ms, sequenceid=25, compaction requested=true 2023-02-10 07:54:13,846 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:13,846 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:13,846 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:13,846 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:13,846 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,846 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:13,847 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:13,848 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,848 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:13,848 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,848 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:13,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:13,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62d0d156[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:13,849 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:13,850 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,851 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,851 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:13,851 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:13,851 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:13,851 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,851 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:13,856 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:13,856 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,856 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:13,857 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:13,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:13,859 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:13,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:13,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:13,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,859 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:13,860 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,860 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,860 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:13,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:13,861 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:13,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,862 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,864 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,864 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:13,864 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:13,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:13,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:13,864 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,864 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:13,864 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:13,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:13,865 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:13,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:13,865 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:13,864 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:13,865 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,865 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,865 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,965 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:13,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:13,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:13,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:13,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,973 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:13,973 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:13,973 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:13,973 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:13,973 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,973 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,975 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:13,975 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:13,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:13,975 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:13,975 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:13,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:13,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,978 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:13,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:13,978 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:13,978 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:13,978 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:13,978 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:13,978 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:13,978 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:13,978 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:13,978 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:14,393 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101df46337d03a84c62b4973185fbd4d666 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101df46337d03a84c62b4973185fbd4d666 2023-02-10 07:54:14,577 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:54:14,800 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/41ea111fb2ee494abdd717d4cbf2737b 2023-02-10 07:54:14,806 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/41ea111fb2ee494abdd717d4cbf2737b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/41ea111fb2ee494abdd717d4cbf2737b 2023-02-10 07:54:14,812 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/41ea111fb2ee494abdd717d4cbf2737b, entries=1, sequenceid=29, filesize=4.9 K 2023-02-10 07:54:14,813 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 835ms, sequenceid=29, compaction requested=true 2023-02-10 07:54:14,813 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:14,813 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:14,814 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:14,814 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:14,814 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,814 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:14,814 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:14,815 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,815 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:14,816 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,816 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:14,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2562ed00[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:14,817 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:14,817 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,818 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,819 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:14,819 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:14,819 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:14,819 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,819 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:14,821 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,821 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:14,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:14,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:14,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:14,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:14,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:14,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:14,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:14,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:14,824 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:14,824 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:14,825 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:14,825 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,825 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:14,826 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,826 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,827 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:14,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:14,827 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,829 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:14,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,831 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,831 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:14,831 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:14,831 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:14,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:14,831 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:14,831 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:14,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:14,831 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:14,832 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:14,832 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:14,832 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:14,832 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,832 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,932 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:14,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:14,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:14,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:14,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,939 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:14,939 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:14,939 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:14,939 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:14,939 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,939 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,940 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:14,940 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:14,941 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:14,941 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:14,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,942 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,942 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:14,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:14,942 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:14,942 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:14,942 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:14,942 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:14,942 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:14,942 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:14,942 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:14,942 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:15,355 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031830328f75b54f6c939a8b8c5d22ee78 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601031830328f75b54f6c939a8b8c5d22ee78 2023-02-10 07:54:15,761 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/34aba40b129640f983a9e5d8efbe9074 2023-02-10 07:54:15,767 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/34aba40b129640f983a9e5d8efbe9074 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/34aba40b129640f983a9e5d8efbe9074 2023-02-10 07:54:15,772 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/34aba40b129640f983a9e5d8efbe9074, entries=1, sequenceid=33, filesize=4.9 K 2023-02-10 07:54:15,773 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 831ms, sequenceid=33, compaction requested=true 2023-02-10 07:54:15,774 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:15,774 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:15,774 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:15,776 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,776 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:15,776 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,776 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:15,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:15,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:15,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a2df00[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:15,777 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:15,778 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,779 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:15,779 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,779 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:15,779 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:15,780 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,781 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:15,781 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:15,781 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:15,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:15,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:15,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:15,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:15,783 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:15,783 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:15,783 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:15,783 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,783 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:15,786 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,786 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:15,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,786 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:15,786 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,787 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:15,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:15,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:15,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:15,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:15,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:15,790 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:15,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:15,791 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:15,791 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,791 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:15,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:15,891 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:15,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:15,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:15,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:15,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,899 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:15,899 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:15,899 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:15,899 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:15,899 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,899 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,900 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:15,900 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:15,901 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:15,901 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,901 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,902 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,902 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:15,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:15,902 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:15,902 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:15,902 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:15,902 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:16,315 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c4b9b458ffa444ee831634b212a22eaf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907c4b9b458ffa444ee831634b212a22eaf 2023-02-10 07:54:16,721 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/9adc9bcd147946b8b0ef659e5b29b28e 2023-02-10 07:54:16,726 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/9adc9bcd147946b8b0ef659e5b29b28e as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9adc9bcd147946b8b0ef659e5b29b28e 2023-02-10 07:54:16,731 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9adc9bcd147946b8b0ef659e5b29b28e, entries=1, sequenceid=37, filesize=4.9 K 2023-02-10 07:54:16,732 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 829ms, sequenceid=37, compaction requested=true 2023-02-10 07:54:16,732 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:16,732 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:16,732 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:16,732 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:16,732 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,732 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:16,732 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:16,733 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,733 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:16,734 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:16,734 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:16,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:16,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:16,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28a737b7[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:16,735 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:16,736 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,740 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,740 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:16,740 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:16,740 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:16,741 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,741 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:16,742 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,742 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:16,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:16,742 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:16,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:16,742 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:16,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:16,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:16,745 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:16,745 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:16,745 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:16,745 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,745 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:16,747 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,747 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:16,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,747 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,747 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:16,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:16,749 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:16,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:16,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:16,751 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,751 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:16,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:16,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:16,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:16,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:16,752 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:16,752 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:16,852 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:16,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:16,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,859 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:16,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:16,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:16,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:16,860 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,860 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,862 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,862 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:16,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:16,862 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:16,862 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,863 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,863 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,863 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:16,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:16,863 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:16,863 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:16,863 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:16,864 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:16,864 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:16,864 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. started... 2023-02-10 07:54:16,864 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ec0407a8776641eb4bea5746b0db281e 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:17,277 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120840c997ab0704b20af2d7d9d4d3b9fd6 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120840c997ab0704b20af2d7d9d4d3b9fd6 2023-02-10 07:54:17,683 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/7946a147cfd045f1b995bceef7725181 2023-02-10 07:54:17,689 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/7946a147cfd045f1b995bceef7725181 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7946a147cfd045f1b995bceef7725181 2023-02-10 07:54:17,693 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7946a147cfd045f1b995bceef7725181, entries=1, sequenceid=41, filesize=4.9 K 2023-02-10 07:54:17,694 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec0407a8776641eb4bea5746b0db281e in 830ms, sequenceid=41, compaction requested=true 2023-02-10 07:54:17,694 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:17,694 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:17,694 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:17,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:17,696 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,696 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:17,696 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,697 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:17,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c191994[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:17,698 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:17,698 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,699 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,699 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:17,699 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:17,699 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:17,699 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,699 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:17,700 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,700 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:17,700 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:17,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:17,700 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:17,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:17,703 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:17,703 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:17,703 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:17,703 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,703 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:17,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:17,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:17,710 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:17,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,711 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,713 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,713 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:17,713 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,713 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:17,713 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-10 07:54:17,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:17,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:17,713 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:17,713 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:17,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:17,714 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,714 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:17,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:17,714 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,714 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:17,714 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,814 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:17,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:17,817 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-10 07:54:17,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:17,820 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:17,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:17,821 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016257821 2023-02-10 07:54:17,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-10 07:54:17,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-10 07:54:17,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:17,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x6c87b3c0 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:54:17,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b596e2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:54:17,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,677 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e16b385889ae43548ba17822a77bb8eb to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e16b385889ae43548ba17822a77bb8eb 2023-02-10 07:54:18,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:18,691 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:54:18,692 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37422, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:54:18,698 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:54:18,700 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36138, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:54:18,708 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8e9b4bb59c684369a6370711c9b3042d first=Optional[r3] last=Optional[r6] 2023-02-10 07:54:18,709 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8e9b4bb59c684369a6370711c9b3042d}] 2023-02-10 07:54:18,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8e9b4bb59c684369a6370711c9b3042d for inclusion in ec0407a8776641eb4bea5746b0db281e/family1 2023-02-10 07:54:18,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-10 07:54:18,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:18,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:18,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8e9b4bb59c684369a6370711c9b3042d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__94k2n0duo6km5p95d3dm2dvmnimj6mmjku77vijmr4r07va90393390jfjb6v5ng/family1/8e9b4bb59c684369a6370711c9b3042d 2023-02-10 07:54:18,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__94k2n0duo6km5p95d3dm2dvmnimj6mmjku77vijmr4r07va90393390jfjb6v5ng/family1/8e9b4bb59c684369a6370711c9b3042d as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/ef9be12df7c742b182e92b15588b4ebf_SeqId_44_ 2023-02-10 07:54:18,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__94k2n0duo6km5p95d3dm2dvmnimj6mmjku77vijmr4r07va90393390jfjb6v5ng/family1/8e9b4bb59c684369a6370711c9b3042d into ec0407a8776641eb4bea5746b0db281e/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/ef9be12df7c742b182e92b15588b4ebf_SeqId_44_ - updating store file list. 2023-02-10 07:54:18,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/ef9be12df7c742b182e92b15588b4ebf_SeqId_44_ into ec0407a8776641eb4bea5746b0db281e/family1 2023-02-10 07:54:18,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__94k2n0duo6km5p95d3dm2dvmnimj6mmjku77vijmr4r07va90393390jfjb6v5ng/family1/8e9b4bb59c684369a6370711c9b3042d into ec0407a8776641eb4bea5746b0db281e/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/ef9be12df7c742b182e92b15588b4ebf_SeqId_44_) 2023-02-10 07:54:18,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__94k2n0duo6km5p95d3dm2dvmnimj6mmjku77vijmr4r07va90393390jfjb6v5ng/family1/8e9b4bb59c684369a6370711c9b3042d 2023-02-10 07:54:18,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-10 07:54:18,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-10 07:54:18,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): ec0407a8776641eb4bea5746b0db281e/family1 is initiating minor compaction 2023-02-10 07:54:18,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7b07909d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:18,729 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of ec0407a8776641eb4bea5746b0db281e/family1 in testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:18,729 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/12ca3b02bc864854a5f1fe53f5741176, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/6fb7b9639ef646138de8c4d27eb84c28, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/2c1d5577245d46228c6a0c1d8659e766, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/97691284d5c540e8a41d20006ad8974f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/85c3fe666aaf40309f15a9569d71a559, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/41ea111fb2ee494abdd717d4cbf2737b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/34aba40b129640f983a9e5d8efbe9074, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9adc9bcd147946b8b0ef659e5b29b28e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7946a147cfd045f1b995bceef7725181, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/ef9be12df7c742b182e92b15588b4ebf_SeqId_44_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp, totalSize=50.0 K 2023-02-10 07:54:18,729 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 12ca3b02bc864854a5f1fe53f5741176, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-10 07:54:18,729 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 6fb7b9639ef646138de8c4d27eb84c28, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-10 07:54:18,729 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 2c1d5577245d46228c6a0c1d8659e766, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-10 07:54:18,729 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 97691284d5c540e8a41d20006ad8974f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-10 07:54:18,730 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 85c3fe666aaf40309f15a9569d71a559, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-10 07:54:18,730 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 41ea111fb2ee494abdd717d4cbf2737b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-10 07:54:18,730 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 34aba40b129640f983a9e5d8efbe9074, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-10 07:54:18,730 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 9adc9bcd147946b8b0ef659e5b29b28e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-10 07:54:18,730 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 7946a147cfd045f1b995bceef7725181, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-10 07:54:18,730 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting ef9be12df7c742b182e92b15588b4ebf_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-10 07:54:18,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:18,732 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:18,733 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122875dfe17ffaac492da6d0ff09c59dc85b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015122875dfe17ffaac492da6d0ff09c59dc85b 2023-02-10 07:54:18,735 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319f4b0f05dc8d4b59846acf4a67a5c69a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319f4b0f05dc8d4b59846acf4a67a5c69a 2023-02-10 07:54:18,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101df46337d03a84c62b4973185fbd4d666 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101df46337d03a84c62b4973185fbd4d666 2023-02-10 07:54:18,737 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601031830328f75b54f6c939a8b8c5d22ee78 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601031830328f75b54f6c939a8b8c5d22ee78 2023-02-10 07:54:18,737 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-10 07:54:18,737 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-10 07:54:18,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:18,769 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): ec0407a8776641eb4bea5746b0db281e#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:19,184 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e15e92b3dd20493d8f4c00a7ea2da843 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205e15e92b3dd20493d8f4c00a7ea2da843 2023-02-10 07:54:19,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:19,189 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/9df0a80c56b84949bad71f4c5c3390e7 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9df0a80c56b84949bad71f4c5c3390e7 2023-02-10 07:54:19,195 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ec0407a8776641eb4bea5746b0db281e/family1 of ec0407a8776641eb4bea5746b0db281e into 9df0a80c56b84949bad71f4c5c3390e7(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:54:19,195 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:19,195 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676015658729; duration=0sec 2023-02-10 07:54:19,196 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:19,228 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/792c62d25cd449fd84d6af4784f3813b first=Optional[r1] last=Optional[r2] 2023-02-10 07:54:19,229 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/792c62d25cd449fd84d6af4784f3813b}] 2023-02-10 07:54:19,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/792c62d25cd449fd84d6af4784f3813b for inclusion in ec0407a8776641eb4bea5746b0db281e/family1 2023-02-10 07:54:19,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-10 07:54:19,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:19,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:19,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/792c62d25cd449fd84d6af4784f3813b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5at7espe0ujrn5idurnkhs8fmeoqqokrirph5eht1uv9vcrqfa241lngicvg4nf/family1/792c62d25cd449fd84d6af4784f3813b 2023-02-10 07:54:19,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5at7espe0ujrn5idurnkhs8fmeoqqokrirph5eht1uv9vcrqfa241lngicvg4nf/family1/792c62d25cd449fd84d6af4784f3813b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_ 2023-02-10 07:54:19,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5at7espe0ujrn5idurnkhs8fmeoqqokrirph5eht1uv9vcrqfa241lngicvg4nf/family1/792c62d25cd449fd84d6af4784f3813b into ec0407a8776641eb4bea5746b0db281e/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_ - updating store file list. 2023-02-10 07:54:19,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_ into ec0407a8776641eb4bea5746b0db281e/family1 2023-02-10 07:54:19,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5at7espe0ujrn5idurnkhs8fmeoqqokrirph5eht1uv9vcrqfa241lngicvg4nf/family1/792c62d25cd449fd84d6af4784f3813b into ec0407a8776641eb4bea5746b0db281e/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_) 2023-02-10 07:54:19,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithWeeklyPolicy__k5at7espe0ujrn5idurnkhs8fmeoqqokrirph5eht1uv9vcrqfa241lngicvg4nf/family1/792c62d25cd449fd84d6af4784f3813b 2023-02-10 07:54:19,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-10 07:54:19,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-10 07:54:19,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): ec0407a8776641eb4bea5746b0db281e/family1 is initiating minor compaction (all files) 2023-02-10 07:54:19,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6cbb6127; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:19,250 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of ec0407a8776641eb4bea5746b0db281e/family1 in testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:54:19,251 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/0671e9ef865d4d2da776dfda737ec3ff, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9df0a80c56b84949bad71f4c5c3390e7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp, totalSize=176.8 K 2023-02-10 07:54:19,251 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0671e9ef865d4d2da776dfda737ec3ff, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842896 2023-02-10 07:54:19,252 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 9df0a80c56b84949bad71f4c5c3390e7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242896 2023-02-10 07:54:19,252 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242896 2023-02-10 07:54:19,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:19,260 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:19,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/12ca3b02bc864854a5f1fe53f5741176, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/6fb7b9639ef646138de8c4d27eb84c28, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/2c1d5577245d46228c6a0c1d8659e766, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/97691284d5c540e8a41d20006ad8974f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/85c3fe666aaf40309f15a9569d71a559, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/41ea111fb2ee494abdd717d4cbf2737b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/34aba40b129640f983a9e5d8efbe9074, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9adc9bcd147946b8b0ef659e5b29b28e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7946a147cfd045f1b995bceef7725181, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/ef9be12df7c742b182e92b15588b4ebf_SeqId_44_] to archive 2023-02-10 07:54:19,271 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010d5078a0f23a4c54b16406c126eb7e33 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010d5078a0f23a4c54b16406c126eb7e33 2023-02-10 07:54:19,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:19,273 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120535b07515b9344cccb1bb274705561118 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120535b07515b9344cccb1bb274705561118 2023-02-10 07:54:19,273 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-10 07:54:19,273 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-10 07:54:19,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/12ca3b02bc864854a5f1fe53f5741176 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/12ca3b02bc864854a5f1fe53f5741176 2023-02-10 07:54:19,274 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:19,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:19,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:19,275 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:19,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/6fb7b9639ef646138de8c4d27eb84c28 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/6fb7b9639ef646138de8c4d27eb84c28 2023-02-10 07:54:19,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4570 sec 2023-02-10 07:54:19,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/2c1d5577245d46228c6a0c1d8659e766 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/2c1d5577245d46228c6a0c1d8659e766 2023-02-10 07:54:19,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/97691284d5c540e8a41d20006ad8974f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/97691284d5c540e8a41d20006ad8974f 2023-02-10 07:54:19,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/85c3fe666aaf40309f15a9569d71a559 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/85c3fe666aaf40309f15a9569d71a559 2023-02-10 07:54:19,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/41ea111fb2ee494abdd717d4cbf2737b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/41ea111fb2ee494abdd717d4cbf2737b 2023-02-10 07:54:19,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/34aba40b129640f983a9e5d8efbe9074 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/34aba40b129640f983a9e5d8efbe9074 2023-02-10 07:54:19,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9adc9bcd147946b8b0ef659e5b29b28e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9adc9bcd147946b8b0ef659e5b29b28e 2023-02-10 07:54:19,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7946a147cfd045f1b995bceef7725181 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7946a147cfd045f1b995bceef7725181 2023-02-10 07:54:19,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/ef9be12df7c742b182e92b15588b4ebf_SeqId_44_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/ef9be12df7c742b182e92b15588b4ebf_SeqId_44_ 2023-02-10 07:54:19,290 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): ec0407a8776641eb4bea5746b0db281e#family1#compaction#35 average throughput is 12.89 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:19,421 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=250 (was 264), OpenFileDescriptor=590 (was 624), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=275 (was 326), ProcessCount=168 (was 168), AvailableMemoryMB=3505 (was 3792) 2023-02-10 07:54:19,448 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=250, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=275, ProcessCount=168, AvailableMemoryMB=3505 2023-02-10 07:54:19,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-10 07:54:19,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:19,454 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:54:19,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-10 07:54:19,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:54:19,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-10 07:54:19,462 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:19,464 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63 empty. 2023-02-10 07:54:19,464 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:19,464 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:19,465 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:19,465 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16 empty. 2023-02-10 07:54:19,465 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23 empty. 2023-02-10 07:54:19,465 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:19,466 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:19,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-10 07:54:19,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-10 07:54:19,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-10 07:54:19,884 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-10 07:54:19,886 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5d50e7bb530a01bd0ea940d256ad4a23, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:54:19,886 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0aaeaf078f45314fa03e7ff30525cd63, NAME => 'testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:54:19,886 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => f957aa8892773e2f88620aa538a84f16, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:54:20,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-10 07:54:20,114 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/.tmp/family1/d34fed16810a4c319fb5c91dab55b04c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/d34fed16810a4c319fb5c91dab55b04c 2023-02-10 07:54:20,121 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ec0407a8776641eb4bea5746b0db281e/family1 of ec0407a8776641eb4bea5746b0db281e into d34fed16810a4c319fb5c91dab55b04c(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:54:20,121 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for ec0407a8776641eb4bea5746b0db281e: 2023-02-10 07:54:20,121 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676015659250; duration=0sec 2023-02-10 07:54:20,121 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:20,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/0671e9ef865d4d2da776dfda737ec3ff, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9df0a80c56b84949bad71f4c5c3390e7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_] to archive 2023-02-10 07:54:20,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:20,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/0671e9ef865d4d2da776dfda737ec3ff to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/0671e9ef865d4d2da776dfda737ec3ff 2023-02-10 07:54:20,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9df0a80c56b84949bad71f4c5c3390e7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/9df0a80c56b84949bad71f4c5c3390e7 2023-02-10 07:54:20,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/family1/7cc21c2af84b40f49f4f203a200e77fb_SeqId_47_ 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 0aaeaf078f45314fa03e7ff30525cd63, disabling compactions & flushes 2023-02-10 07:54:20,299 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 5d50e7bb530a01bd0ea940d256ad4a23, disabling compactions & flushes 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. after waiting 0 ms 2023-02-10 07:54:20,299 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. after waiting 0 ms 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:20,299 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:20,299 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 0aaeaf078f45314fa03e7ff30525cd63: Waiting for close lock at 1676015660299Disabling compacts and flushes for region at 1676015660299Disabling writes for close at 1676015660299Writing region close event to WAL at 1676015660299Closed at 1676015660299 2023-02-10 07:54:20,299 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 5d50e7bb530a01bd0ea940d256ad4a23: Waiting for close lock at 1676015660299Disabling compacts and flushes for region at 1676015660299Disabling writes for close at 1676015660299Writing region close event to WAL at 1676015660299Closed at 1676015660299 2023-02-10 07:54:20,302 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:20,302 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing f957aa8892773e2f88620aa538a84f16, disabling compactions & flushes 2023-02-10 07:54:20,302 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:20,302 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:20,302 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. after waiting 0 ms 2023-02-10 07:54:20,302 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:20,302 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:20,302 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for f957aa8892773e2f88620aa538a84f16: Waiting for close lock at 1676015660302Disabling compacts and flushes for region at 1676015660302Disabling writes for close at 1676015660302Writing region close event to WAL at 1676015660302Closed at 1676015660302 2023-02-10 07:54:20,304 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:54:20,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676015660305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015660305"}]},"ts":"1676015660305"} 2023-02-10 07:54:20,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676015660305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015660305"}]},"ts":"1676015660305"} 2023-02-10 07:54:20,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676015660305"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015660305"}]},"ts":"1676015660305"} 2023-02-10 07:54:20,308 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-10 07:54:20,309 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:54:20,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015660309"}]},"ts":"1676015660309"} 2023-02-10 07:54:20,310 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-10 07:54:20,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0aaeaf078f45314fa03e7ff30525cd63, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=f957aa8892773e2f88620aa538a84f16, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d50e7bb530a01bd0ea940d256ad4a23, ASSIGN}] 2023-02-10 07:54:20,316 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0aaeaf078f45314fa03e7ff30525cd63, ASSIGN 2023-02-10 07:54:20,316 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=f957aa8892773e2f88620aa538a84f16, ASSIGN 2023-02-10 07:54:20,316 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d50e7bb530a01bd0ea940d256ad4a23, ASSIGN 2023-02-10 07:54:20,317 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=f957aa8892773e2f88620aa538a84f16, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:54:20,317 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0aaeaf078f45314fa03e7ff30525cd63, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:54:20,317 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d50e7bb530a01bd0ea940d256ad4a23, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:54:20,468 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0aaeaf078f45314fa03e7ff30525cd63, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:20,468 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f957aa8892773e2f88620aa538a84f16, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:20,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5d50e7bb530a01bd0ea940d256ad4a23, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:20,469 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676015660468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015660468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015660468"}]},"ts":"1676015660468"} 2023-02-10 07:54:20,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676015660468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015660468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015660468"}]},"ts":"1676015660468"} 2023-02-10 07:54:20,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676015660468"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015660468"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015660468"}]},"ts":"1676015660468"} 2023-02-10 07:54:20,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure f957aa8892773e2f88620aa538a84f16, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:20,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 5d50e7bb530a01bd0ea940d256ad4a23, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:20,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 0aaeaf078f45314fa03e7ff30525cd63, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:20,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-10 07:54:20,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:20,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f957aa8892773e2f88620aa538a84f16, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16.', STARTKEY => '1', ENDKEY => '2'} 2023-02-10 07:54:20,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:20,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:20,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:20,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:20,627 INFO [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:20,629 DEBUG [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16/family1 2023-02-10 07:54:20,629 DEBUG [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16/family1 2023-02-10 07:54:20,630 INFO [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f957aa8892773e2f88620aa538a84f16 columnFamilyName family1 2023-02-10 07:54:20,631 INFO [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] regionserver.HStore(310): Store=f957aa8892773e2f88620aa538a84f16/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:20,631 INFO [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:20,633 DEBUG [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16/family2 2023-02-10 07:54:20,633 DEBUG [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16/family2 2023-02-10 07:54:20,633 INFO [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f957aa8892773e2f88620aa538a84f16 columnFamilyName family2 2023-02-10 07:54:20,634 INFO [StoreOpener-f957aa8892773e2f88620aa538a84f16-1] regionserver.HStore(310): Store=f957aa8892773e2f88620aa538a84f16/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:20,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:20,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:20,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:54:20,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f957aa8892773e2f88620aa538a84f16 2023-02-10 07:54:20,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:54:20,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f957aa8892773e2f88620aa538a84f16; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62979380, jitterRate=-0.061534106731414795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:54:20,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f957aa8892773e2f88620aa538a84f16: Running coprocessor pre-open hook at 1676015660626Writing region info on filesystem at 1676015660626Initializing all the Stores at 1676015660627 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015660627Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015660627Cleaning up temporary data from old regions at 1676015660637 (+10 ms)Cleaning up detritus from prior splits at 1676015660637Running coprocessor post-open hooks at 1676015660641 (+4 ms)Region opened successfully at 1676015660641 2023-02-10 07:54:20,642 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16., pid=31, masterSystemTime=1676015660623 2023-02-10 07:54:20,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:20,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:20,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:20,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5d50e7bb530a01bd0ea940d256ad4a23, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23.', STARTKEY => '2', ENDKEY => ''} 2023-02-10 07:54:20,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:20,644 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f957aa8892773e2f88620aa538a84f16, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:20,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:20,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:20,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:20,644 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676015660644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015660644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015660644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015660644"}]},"ts":"1676015660644"} 2023-02-10 07:54:20,645 INFO [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:20,647 DEBUG [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1 2023-02-10 07:54:20,647 DEBUG [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1 2023-02-10 07:54:20,647 INFO [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d50e7bb530a01bd0ea940d256ad4a23 columnFamilyName family1 2023-02-10 07:54:20,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-02-10 07:54:20,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure f957aa8892773e2f88620aa538a84f16, server=jenkins-hbase4.apache.org,36907,1676015618909 in 174 msec 2023-02-10 07:54:20,648 INFO [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] regionserver.HStore(310): Store=5d50e7bb530a01bd0ea940d256ad4a23/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:20,648 INFO [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:20,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=f957aa8892773e2f88620aa538a84f16, ASSIGN in 333 msec 2023-02-10 07:54:20,650 DEBUG [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family2 2023-02-10 07:54:20,650 DEBUG [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family2 2023-02-10 07:54:20,651 INFO [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d50e7bb530a01bd0ea940d256ad4a23 columnFamilyName family2 2023-02-10 07:54:20,652 INFO [StoreOpener-5d50e7bb530a01bd0ea940d256ad4a23-1] regionserver.HStore(310): Store=5d50e7bb530a01bd0ea940d256ad4a23/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:20,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:20,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:20,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:54:20,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:54:20,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:54:20,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5d50e7bb530a01bd0ea940d256ad4a23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60490463, jitterRate=-0.09862186014652252}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:54:20,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5d50e7bb530a01bd0ea940d256ad4a23: Running coprocessor pre-open hook at 1676015660644Writing region info on filesystem at 1676015660644Initializing all the Stores at 1676015660645 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015660645Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015660645Cleaning up temporary data from old regions at 1676015660653 (+8 ms)Cleaning up detritus from prior splits at 1676015660654 (+1 ms)Running coprocessor post-open hooks at 1676015660657 (+3 ms)Region opened successfully at 1676015660657 2023-02-10 07:54:20,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23., pid=32, masterSystemTime=1676015660623 2023-02-10 07:54:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:20,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:20,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0aaeaf078f45314fa03e7ff30525cd63, NAME => 'testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63.', STARTKEY => '', ENDKEY => '1'} 2023-02-10 07:54:20,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:20,660 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5d50e7bb530a01bd0ea940d256ad4a23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:20,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:20,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:20,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:20,660 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676015660659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015660659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015660659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015660659"}]},"ts":"1676015660659"} 2023-02-10 07:54:20,661 INFO [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:20,662 DEBUG [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63/family1 2023-02-10 07:54:20,662 DEBUG [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63/family1 2023-02-10 07:54:20,663 INFO [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0aaeaf078f45314fa03e7ff30525cd63 columnFamilyName family1 2023-02-10 07:54:20,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-02-10 07:54:20,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 5d50e7bb530a01bd0ea940d256ad4a23, server=jenkins-hbase4.apache.org,36907,1676015618909 in 190 msec 2023-02-10 07:54:20,664 INFO [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] regionserver.HStore(310): Store=0aaeaf078f45314fa03e7ff30525cd63/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:20,664 INFO [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:20,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d50e7bb530a01bd0ea940d256ad4a23, ASSIGN in 349 msec 2023-02-10 07:54:20,665 DEBUG [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63/family2 2023-02-10 07:54:20,665 DEBUG [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63/family2 2023-02-10 07:54:20,665 INFO [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0aaeaf078f45314fa03e7ff30525cd63 columnFamilyName family2 2023-02-10 07:54:20,666 INFO [StoreOpener-0aaeaf078f45314fa03e7ff30525cd63-1] regionserver.HStore(310): Store=0aaeaf078f45314fa03e7ff30525cd63/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:20,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:20,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:54:20,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:54:20,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:54:20,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0aaeaf078f45314fa03e7ff30525cd63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61721918, jitterRate=-0.08027175068855286}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:54:20,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0aaeaf078f45314fa03e7ff30525cd63: Running coprocessor pre-open hook at 1676015660660Writing region info on filesystem at 1676015660660Initializing all the Stores at 1676015660661 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015660661Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015660661Cleaning up temporary data from old regions at 1676015660668 (+7 ms)Cleaning up detritus from prior splits at 1676015660668Running coprocessor post-open hooks at 1676015660672 (+4 ms)Region opened successfully at 1676015660672 2023-02-10 07:54:20,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63., pid=33, masterSystemTime=1676015660623 2023-02-10 07:54:20,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:20,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:20,674 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=0aaeaf078f45314fa03e7ff30525cd63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:20,674 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676015660674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015660674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015660674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015660674"}]},"ts":"1676015660674"} 2023-02-10 07:54:20,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-02-10 07:54:20,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 0aaeaf078f45314fa03e7ff30525cd63, server=jenkins-hbase4.apache.org,36907,1676015618909 in 203 msec 2023-02-10 07:54:20,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-02-10 07:54:20,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0aaeaf078f45314fa03e7ff30525cd63, ASSIGN in 363 msec 2023-02-10 07:54:20,679 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:54:20,679 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015660679"}]},"ts":"1676015660679"} 2023-02-10 07:54:20,680 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-10 07:54:20,682 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:54:20,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2310 sec 2023-02-10 07:54:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-10 07:54:21,562 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-10 07:54:21,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:21,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:21,570 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-10 07:54:21,570 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:21,570 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-10 07:54:21,570 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-10 07:54:21,570 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:21,570 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:21,572 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:21,572 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:21,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:21,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:21,572 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:21,572 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:21,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:21,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:21,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:21,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:21,573 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:21,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:21,573 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-10 07:54:21,573 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:21,573 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-10 07:54:21,573 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:21,573 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. started... 2023-02-10 07:54:21,575 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0aaeaf078f45314fa03e7ff30525cd63: 2023-02-10 07:54:21,575 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:21,575 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:21,575 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. started... 2023-02-10 07:54:21,575 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:21,575 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:54:21,575 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:21,575 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f957aa8892773e2f88620aa538a84f16: 2023-02-10 07:54:21,575 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. started... 2023-02-10 07:54:21,576 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:21,576 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5d50e7bb530a01bd0ea940d256ad4a23 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-10 07:54:21,575 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:54:21,576 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:54:21,990 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021074427f6a70804755921024666dce131b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021074427f6a70804755921024666dce131b 2023-02-10 07:54:22,396 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/.tmp/family1/26fc4457437e4615b74ef72f92c60e89 2023-02-10 07:54:22,402 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/.tmp/family1/26fc4457437e4615b74ef72f92c60e89 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/26fc4457437e4615b74ef72f92c60e89 2023-02-10 07:54:22,406 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/26fc4457437e4615b74ef72f92c60e89, entries=1, sequenceid=5, filesize=4.9 K 2023-02-10 07:54:22,407 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 5d50e7bb530a01bd0ea940d256ad4a23 in 831ms, sequenceid=5, compaction requested=false 2023-02-10 07:54:22,407 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-10 07:54:22,408 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d50e7bb530a01bd0ea940d256ad4a23: 2023-02-10 07:54:22,408 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:22,408 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:54:22,408 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:54:22,408 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,408 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-10 07:54:22,408 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-10 07:54:22,410 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,410 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:22,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:22,410 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,410 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:22,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-10 07:54:22,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ea1f7fa[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:22,412 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-10 07:54:22,412 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,414 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,414 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-10 07:54:22,415 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,415 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:22,415 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-10 07:54:22,415 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:22,416 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,416 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-10 07:54:22,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:22,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:22,416 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:22,416 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-10 07:54:22,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:22,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:22,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:22,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:22,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-10 07:54:22,419 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-10 07:54:22,419 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:22,419 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:22,419 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,419 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:22,420 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,420 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:22,420 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:22,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:22,421 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:22,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,422 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:22,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,432 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,432 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:22,432 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-10 07:54:22,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-10 07:54:22,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:22,432 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,432 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:22,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:22,432 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:22,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:22,432 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,432 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:22,433 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:22,433 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:22,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:22,433 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,433 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,533 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:22,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:22,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:22,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:22,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,540 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-10 07:54:22,540 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:22,540 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-10 07:54:22,540 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-10 07:54:22,540 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,540 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,541 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:22,541 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:22,542 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:22,542 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,542 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,542 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-10 07:54:22,543 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:22,543 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-10 07:54:22,543 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:22,543 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:22,543 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:54:22,543 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. started... 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. started... 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. started... 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0aaeaf078f45314fa03e7ff30525cd63: 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f957aa8892773e2f88620aa538a84f16: 2023-02-10 07:54:22,543 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5d50e7bb530a01bd0ea940d256ad4a23 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:54:22,543 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:54:22,544 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:54:22,544 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:54:22,960 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210dce71768678e4dde8fef1440bfad22e9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230210dce71768678e4dde8fef1440bfad22e9 2023-02-10 07:54:23,365 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/.tmp/family1/ff66ef3f8ada4d649c1cf501adcb9310 2023-02-10 07:54:23,370 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/.tmp/family1/ff66ef3f8ada4d649c1cf501adcb9310 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/ff66ef3f8ada4d649c1cf501adcb9310 2023-02-10 07:54:23,374 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/ff66ef3f8ada4d649c1cf501adcb9310, entries=2, sequenceid=9, filesize=5.0 K 2023-02-10 07:54:23,375 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 5d50e7bb530a01bd0ea940d256ad4a23 in 832ms, sequenceid=9, compaction requested=false 2023-02-10 07:54:23,375 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d50e7bb530a01bd0ea940d256ad4a23: 2023-02-10 07:54:23,375 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:23,375 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:54:23,376 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:54:23,376 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,376 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-10 07:54:23,376 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-10 07:54:23,377 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,377 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:23,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:23,378 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,378 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:23,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:23,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:23,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:23,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-10 07:54:23,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61646df1[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:23,379 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-10 07:54:23,379 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,380 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,381 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-10 07:54:23,381 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-10 07:54:23,381 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:23,381 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,381 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:23,383 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,383 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-10 07:54:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,383 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:23,383 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-10 07:54:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:23,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:23,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-10 07:54:23,386 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-10 07:54:23,387 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:23,387 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:23,387 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,387 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:23,388 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,388 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:23,388 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:23,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:23,389 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:23,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,394 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,396 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:23,396 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:23,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:23,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:23,396 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-10 07:54:23,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:23,397 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:23,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:23,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:23,497 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:23,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:23,505 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-10 07:54:23,507 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-10 07:54:23,507 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-10 07:54:23,508 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016263508 2023-02-10 07:54:23,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:23,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:54:23,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-10 07:54:23,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-10 07:54:23,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x7dff75b3 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:54:23,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d575c3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:54:23,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230210 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-10 07:54:24,342 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302106d838d4fb6ab4222ae228b18b981762c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302106d838d4fb6ab4222ae228b18b981762c 2023-02-10 07:54:24,343 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-10 07:54:24,356 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:54:24,357 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52416, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:54:24,364 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:54:24,366 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41726, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:54:24,375 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230210/family1/e8b40269f19643f7a88701446eb6db10 first=Optional[k0] last=Optional[k1] 2023-02-10 07:54:24,376 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230210/family1/e8b40269f19643f7a88701446eb6db10}] 2023-02-10 07:54:24,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230210/family1/e8b40269f19643f7a88701446eb6db10 for inclusion in 5d50e7bb530a01bd0ea940d256ad4a23/family1 2023-02-10 07:54:24,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-10 07:54:24,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-10 07:54:24,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 5d50e7bb530a01bd0ea940d256ad4a23: 2023-02-10 07:54:24,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230210/family1/e8b40269f19643f7a88701446eb6db10 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testScannerOnBulkLoadRefHFiles__e51gfp5e3evt3g2b12c7lnhmeqd20qm3hqfg8fmfndtf204dcus5r5ps316meb8m/family1/e8b40269f19643f7a88701446eb6db10 2023-02-10 07:54:24,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testScannerOnBulkLoadRefHFiles__e51gfp5e3evt3g2b12c7lnhmeqd20qm3hqfg8fmfndtf204dcus5r5ps316meb8m/family1/e8b40269f19643f7a88701446eb6db10 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_ 2023-02-10 07:54:24,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testScannerOnBulkLoadRefHFiles__e51gfp5e3evt3g2b12c7lnhmeqd20qm3hqfg8fmfndtf204dcus5r5ps316meb8m/family1/e8b40269f19643f7a88701446eb6db10 into 5d50e7bb530a01bd0ea940d256ad4a23/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_ - updating store file list. 2023-02-10 07:54:24,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_ into 5d50e7bb530a01bd0ea940d256ad4a23/family1 2023-02-10 07:54:24,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testScannerOnBulkLoadRefHFiles__e51gfp5e3evt3g2b12c7lnhmeqd20qm3hqfg8fmfndtf204dcus5r5ps316meb8m/family1/e8b40269f19643f7a88701446eb6db10 into 5d50e7bb530a01bd0ea940d256ad4a23/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_) 2023-02-10 07:54:24,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testScannerOnBulkLoadRefHFiles__e51gfp5e3evt3g2b12c7lnhmeqd20qm3hqfg8fmfndtf204dcus5r5ps316meb8m/family1/e8b40269f19643f7a88701446eb6db10 2023-02-10 07:54:24,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-10 07:54:24,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-10 07:54:24,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 5d50e7bb530a01bd0ea940d256ad4a23/family1 is initiating minor compaction (all files) 2023-02-10 07:54:24,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d77f365; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:24,390 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5d50e7bb530a01bd0ea940d256ad4a23/family1 in testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:54:24,391 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/26fc4457437e4615b74ef72f92c60e89, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/ff66ef3f8ada4d649c1cf501adcb9310, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/.tmp, totalSize=15.1 K 2023-02-10 07:54:24,391 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 26fc4457437e4615b74ef72f92c60e89, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015661562 2023-02-10 07:54:24,391 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting ff66ef3f8ada4d649c1cf501adcb9310, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015661562 2023-02-10 07:54:24,392 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015661562 2023-02-10 07:54:24,392 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-10 07:54:24,393 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:24,395 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021074427f6a70804755921024666dce131b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021074427f6a70804755921024666dce131b 2023-02-10 07:54:24,396 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230210dce71768678e4dde8fef1440bfad22e9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230210dce71768678e4dde8fef1440bfad22e9 2023-02-10 07:54:24,397 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-10 07:54:24,397 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230210' 2023-02-10 07:54:24,397 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230210 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-10 07:54:24,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-10 07:54:24,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:24,398 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-10 07:54:24,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 892 msec 2023-02-10 07:54:24,403 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5d50e7bb530a01bd0ea940d256ad4a23#family1#compaction#38 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:24,436 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=249 (was 250), OpenFileDescriptor=590 (was 590), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 275), ProcessCount=168 (was 168), AvailableMemoryMB=3496 (was 3505) 2023-02-10 07:54:24,447 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=168, AvailableMemoryMB=3495 2023-02-10 07:54:24,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-10 07:54:24,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:24,451 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:54:24,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-10 07:54:24,451 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:54:24,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-10 07:54:24,453 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:24,453 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997 empty. 2023-02-10 07:54:24,454 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:24,454 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-10 07:54:24,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-10 07:54:24,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-10 07:54:24,834 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/.tmp/family1/b804cebc45ce4646b2bfc673afc65ef6 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/b804cebc45ce4646b2bfc673afc65ef6 2023-02-10 07:54:24,840 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5d50e7bb530a01bd0ea940d256ad4a23/family1 of 5d50e7bb530a01bd0ea940d256ad4a23 into b804cebc45ce4646b2bfc673afc65ef6(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:54:24,840 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5d50e7bb530a01bd0ea940d256ad4a23: 2023-02-10 07:54:24,840 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676015664390; duration=0sec 2023-02-10 07:54:24,841 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:24,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/26fc4457437e4615b74ef72f92c60e89, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/ff66ef3f8ada4d649c1cf501adcb9310, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_] to archive 2023-02-10 07:54:24,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:24,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/26fc4457437e4615b74ef72f92c60e89 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/26fc4457437e4615b74ef72f92c60e89 2023-02-10 07:54:24,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/ff66ef3f8ada4d649c1cf501adcb9310 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/ff66ef3f8ada4d649c1cf501adcb9310 2023-02-10 07:54:24,862 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-10 07:54:24,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/family1/20b9ebf39b134420b85a5fc438cd02fd_SeqId_12_ 2023-02-10 07:54:24,864 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => ecc368e2d160c410bd4b78c7b4016997, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:54:25,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-10 07:54:25,271 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:25,271 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing ecc368e2d160c410bd4b78c7b4016997, disabling compactions & flushes 2023-02-10 07:54:25,271 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:25,271 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:25,271 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. after waiting 0 ms 2023-02-10 07:54:25,271 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:25,271 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:25,271 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for ecc368e2d160c410bd4b78c7b4016997: Waiting for close lock at 1676015665271Disabling compacts and flushes for region at 1676015665271Disabling writes for close at 1676015665271Writing region close event to WAL at 1676015665271Closed at 1676015665271 2023-02-10 07:54:25,274 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:54:25,275 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676015665275"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015665275"}]},"ts":"1676015665275"} 2023-02-10 07:54:25,276 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:54:25,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:54:25,277 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015665277"}]},"ts":"1676015665277"} 2023-02-10 07:54:25,278 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-10 07:54:25,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ecc368e2d160c410bd4b78c7b4016997, ASSIGN}] 2023-02-10 07:54:25,284 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ecc368e2d160c410bd4b78c7b4016997, ASSIGN 2023-02-10 07:54:25,285 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ecc368e2d160c410bd4b78c7b4016997, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:54:25,436 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ecc368e2d160c410bd4b78c7b4016997, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:25,436 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676015665436"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015665436"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015665436"}]},"ts":"1676015665436"} 2023-02-10 07:54:25,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure ecc368e2d160c410bd4b78c7b4016997, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:25,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-10 07:54:25,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:25,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ecc368e2d160c410bd4b78c7b4016997, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:54:25,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:25,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:25,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:25,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:25,594 INFO [StoreOpener-ecc368e2d160c410bd4b78c7b4016997-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:25,595 DEBUG [StoreOpener-ecc368e2d160c410bd4b78c7b4016997-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1 2023-02-10 07:54:25,595 DEBUG [StoreOpener-ecc368e2d160c410bd4b78c7b4016997-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1 2023-02-10 07:54:25,596 INFO [StoreOpener-ecc368e2d160c410bd4b78c7b4016997-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ecc368e2d160c410bd4b78c7b4016997 columnFamilyName family1 2023-02-10 07:54:25,597 INFO [StoreOpener-ecc368e2d160c410bd4b78c7b4016997-1] regionserver.HStore(310): Store=ecc368e2d160c410bd4b78c7b4016997/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:25,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:25,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:25,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:54:25,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:54:25,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ecc368e2d160c410bd4b78c7b4016997; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70797803, jitterRate=0.05496947467327118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:54:25,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ecc368e2d160c410bd4b78c7b4016997: Running coprocessor pre-open hook at 1676015665593Writing region info on filesystem at 1676015665593Initializing all the Stores at 1676015665593Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676015665593Cleaning up temporary data from old regions at 1676015665599 (+6 ms)Cleaning up detritus from prior splits at 1676015665599Running coprocessor post-open hooks at 1676015665603 (+4 ms)Region opened successfully at 1676015665603 2023-02-10 07:54:25,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997., pid=37, masterSystemTime=1676015665589 2023-02-10 07:54:25,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:25,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:25,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=ecc368e2d160c410bd4b78c7b4016997, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:25,606 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676015665606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015665606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015665606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015665606"}]},"ts":"1676015665606"} 2023-02-10 07:54:25,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-10 07:54:25,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure ecc368e2d160c410bd4b78c7b4016997, server=jenkins-hbase4.apache.org,36907,1676015618909 in 170 msec 2023-02-10 07:54:25,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-10 07:54:25,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=ecc368e2d160c410bd4b78c7b4016997, ASSIGN in 327 msec 2023-02-10 07:54:25,611 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:54:25,612 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015665611"}]},"ts":"1676015665611"} 2023-02-10 07:54:25,613 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-10 07:54:25,615 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:54:25,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1660 sec 2023-02-10 07:54:26,153 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:54:26,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-10 07:54:26,557 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-10 07:54:26,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:26,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:26,579 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:26,579 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:26,579 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:26,579 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:26,580 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:26,580 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:26,581 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:26,581 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:26,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:26,581 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:26,581 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:26,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:26,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:26,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:26,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:26,582 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:26,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:26,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:26,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:26,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:26,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:26,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:26,582 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:26,582 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:26,583 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-10 07:54:27,006 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303c5ceacd96184330b484e85681753c35 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511303c5ceacd96184330b484e85681753c35 2023-02-10 07:54:27,410 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/6fad0c428ff249db95adaae953f284bb 2023-02-10 07:54:27,415 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/6fad0c428ff249db95adaae953f284bb as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/6fad0c428ff249db95adaae953f284bb 2023-02-10 07:54:27,419 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/6fad0c428ff249db95adaae953f284bb, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-10 07:54:27,420 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 837ms, sequenceid=5, compaction requested=false 2023-02-10 07:54:27,420 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:27,421 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:27,421 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:27,423 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,423 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:27,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:27,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:27,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70eff4e5[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:27,424 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:27,424 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,425 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,425 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:27,425 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:27,426 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,426 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:27,428 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,428 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:27,428 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:27,428 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:27,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:27,430 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:27,430 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:27,430 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:27,430 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,430 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:27,431 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,431 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:27,431 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:27,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,432 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:27,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,433 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:27,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,435 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,435 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:27,435 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:27,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:27,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:27,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:27,435 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,435 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:27,435 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:27,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:27,435 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:27,436 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:27,435 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,436 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,436 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,436 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,536 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:27,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:27,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:27,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:27,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,542 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:27,543 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:27,543 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:27,543 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:27,543 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,543 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,544 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:27,544 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:27,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:27,544 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:27,544 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:27,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:27,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,545 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:27,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:27,545 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:27,546 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:27,546 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:27,546 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:27,546 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-10 07:54:27,958 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284b8c85c01390488c98cb199c017a401c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511284b8c85c01390488c98cb199c017a401c 2023-02-10 07:54:28,364 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/e3cf6bb7082447a99ecc3908fc3e6e31 2023-02-10 07:54:28,369 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/e3cf6bb7082447a99ecc3908fc3e6e31 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/e3cf6bb7082447a99ecc3908fc3e6e31 2023-02-10 07:54:28,372 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/e3cf6bb7082447a99ecc3908fc3e6e31, entries=1, sequenceid=9, filesize=5.0 K 2023-02-10 07:54:28,373 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 827ms, sequenceid=9, compaction requested=false 2023-02-10 07:54:28,373 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:28,373 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:28,373 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:28,373 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:28,373 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,373 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:28,373 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:28,376 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,376 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:28,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:28,376 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,376 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:28,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:28,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:28,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:28,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:28,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74be86d5[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:28,377 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:28,378 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,385 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,385 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:28,385 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,385 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:28,385 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:28,385 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:28,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:28,387 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:28,387 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:28,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:28,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:28,389 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:28,389 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:28,389 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:28,389 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,389 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:28,391 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,391 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:28,391 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,391 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:28,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:28,392 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:28,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:28,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:28,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:28,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:28,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:28,395 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:28,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:28,396 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:28,396 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,396 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:28,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:28,396 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,396 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,396 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,496 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:28,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:28,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:28,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:28,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,503 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:28,503 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:28,503 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:28,503 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:28,503 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,503 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,504 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:28,504 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:28,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:28,505 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:28,505 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:28,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:28,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,505 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,505 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:28,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:28,506 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:28,506 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:28,506 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:28,506 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:28,919 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cb8023d324d34b198979d3e1f47db94b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb8023d324d34b198979d3e1f47db94b 2023-02-10 07:54:29,324 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/8611c31023444fe68f76e86a339a237f 2023-02-10 07:54:29,329 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/8611c31023444fe68f76e86a339a237f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/8611c31023444fe68f76e86a339a237f 2023-02-10 07:54:29,333 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/8611c31023444fe68f76e86a339a237f, entries=1, sequenceid=13, filesize=4.9 K 2023-02-10 07:54:29,334 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 828ms, sequenceid=13, compaction requested=true 2023-02-10 07:54:29,334 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:29,334 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:29,334 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:29,334 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:29,334 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,334 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:29,334 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:29,336 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,336 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:29,336 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,336 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:29,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:29,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@551b19f[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:29,338 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:29,338 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,339 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,339 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:29,339 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:29,339 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:29,339 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,339 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:29,341 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,341 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:29,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:29,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:29,341 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:29,341 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:29,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:29,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:29,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:29,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:29,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:29,344 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:29,345 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:29,345 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:29,345 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,345 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:29,346 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,347 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,347 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:29,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:29,347 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:29,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:29,349 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:29,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:29,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:29,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:29,351 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:29,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:29,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:29,351 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,352 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,451 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:29,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:29,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:29,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:29,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,458 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:29,458 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:29,458 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:29,458 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:29,459 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,459 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,460 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,460 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:29,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:29,460 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:29,460 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:29,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:29,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,461 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,461 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:29,461 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:29,461 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:29,461 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:29,461 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:29,462 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:29,462 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:29,462 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:29,462 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:29,876 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ca4c2afe47df453789b45fdbd9c58b74 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca4c2afe47df453789b45fdbd9c58b74 2023-02-10 07:54:30,281 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/f87d3ce989274173a5cd1a30dbe46d0f 2023-02-10 07:54:30,286 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/f87d3ce989274173a5cd1a30dbe46d0f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f87d3ce989274173a5cd1a30dbe46d0f 2023-02-10 07:54:30,291 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f87d3ce989274173a5cd1a30dbe46d0f, entries=1, sequenceid=17, filesize=4.9 K 2023-02-10 07:54:30,291 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 829ms, sequenceid=17, compaction requested=true 2023-02-10 07:54:30,292 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:30,292 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:30,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:30,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:30,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:30,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:30,295 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,295 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:30,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:30,295 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,295 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:30,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:30,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:30,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:30,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:30,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47184f21[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:30,296 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:30,296 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,297 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,298 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:30,298 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:30,298 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:30,298 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,298 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:30,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:30,299 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:30,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:30,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:30,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:30,301 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:30,301 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:30,301 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:30,301 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,301 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:30,302 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,302 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:30,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:30,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,302 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:30,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:30,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:30,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:30,303 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:30,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,304 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:30,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:30,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:30,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:30,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:30,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:30,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:30,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:30,307 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:30,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:30,308 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:30,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,308 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:30,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:30,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,408 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:30,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:30,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:30,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:30,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,416 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:30,416 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:30,416 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:30,416 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:30,416 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,416 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,418 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:30,418 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:30,418 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:30,418 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,419 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,420 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:30,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:30,420 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:30,420 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:30,420 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:30,428 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:30,428 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:30,428 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:30,428 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:30,428 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:30,842 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284ed56d6cd02542a9992036caada9093e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512284ed56d6cd02542a9992036caada9093e 2023-02-10 07:54:31,094 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:54:31,248 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/925923c282ff4644a15b15c599353392 2023-02-10 07:54:31,253 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/925923c282ff4644a15b15c599353392 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/925923c282ff4644a15b15c599353392 2023-02-10 07:54:31,256 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/925923c282ff4644a15b15c599353392, entries=1, sequenceid=21, filesize=4.9 K 2023-02-10 07:54:31,257 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 829ms, sequenceid=21, compaction requested=true 2023-02-10 07:54:31,257 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:31,257 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:31,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:31,261 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,261 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:31,262 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,262 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:31,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:31,263 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:31,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48dfc3fb[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:31,263 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,264 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,264 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:31,264 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:31,264 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,264 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:31,264 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:31,266 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,266 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:31,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:31,266 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:31,267 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:31,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:31,269 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:31,269 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:31,269 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:31,269 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,269 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:31,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:31,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:31,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,271 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,272 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,274 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,274 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:31,274 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:31,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:31,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:31,274 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:31,274 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:31,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:31,274 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,275 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,275 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,275 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:31,275 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:31,275 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:31,275 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:31,375 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:31,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:31,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:31,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:31,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,381 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:31,381 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:31,381 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:31,381 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:31,382 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,382 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,383 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:31,383 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:31,383 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:31,383 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:31,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,384 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,384 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:31,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:31,384 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:31,384 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:31,384 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:31,384 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:31,384 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:31,384 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:31,384 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:31,384 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:31,797 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318275581b18e6499fa3038d8b0881bacf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512318275581b18e6499fa3038d8b0881bacf 2023-02-10 07:54:32,202 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/a00d5086d56940b29bd91d84b5d5fc7d 2023-02-10 07:54:32,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/a00d5086d56940b29bd91d84b5d5fc7d as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/a00d5086d56940b29bd91d84b5d5fc7d 2023-02-10 07:54:32,210 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/a00d5086d56940b29bd91d84b5d5fc7d, entries=1, sequenceid=25, filesize=4.9 K 2023-02-10 07:54:32,211 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 827ms, sequenceid=25, compaction requested=true 2023-02-10 07:54:32,211 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:32,211 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:32,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:32,214 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,214 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:32,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:32,215 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,215 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:32,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:32,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:32,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:32,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:32,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48d76c1b[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:32,216 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:32,216 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,217 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:32,217 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:32,217 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:32,217 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,217 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:32,219 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,219 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:32,219 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:32,219 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:32,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:32,221 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:32,221 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:32,221 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:32,221 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,221 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:32,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:32,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:32,223 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,224 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:32,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:32,227 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:32,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:32,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:32,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:32,227 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,228 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,327 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:32,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:32,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:32,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:32,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,335 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:32,335 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:32,335 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:32,335 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:32,335 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,335 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,337 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:32,337 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:32,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:32,337 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:32,337 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:32,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:32,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,338 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,338 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:32,338 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:32,338 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:32,338 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:32,338 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:32,339 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:32,339 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:32,339 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:32,339 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:32,339 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:32,752 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010180ac36749b2d4817a734a0e5cfc51d47 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010180ac36749b2d4817a734a0e5cfc51d47 2023-02-10 07:54:33,157 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/337cbb7478274c368c08286ed80a2218 2023-02-10 07:54:33,163 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/337cbb7478274c368c08286ed80a2218 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/337cbb7478274c368c08286ed80a2218 2023-02-10 07:54:33,167 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/337cbb7478274c368c08286ed80a2218, entries=1, sequenceid=29, filesize=4.9 K 2023-02-10 07:54:33,168 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 829ms, sequenceid=29, compaction requested=true 2023-02-10 07:54:33,168 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:33,168 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:33,168 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:33,168 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:33,168 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,168 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:33,168 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:33,170 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,170 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:33,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:33,171 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,171 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:33,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:33,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:33,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:33,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4002e1d7[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:33,173 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:33,173 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,175 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:33,175 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:33,175 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:33,177 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,177 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:33,179 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:33,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:33,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:33,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:33,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:33,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:33,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:33,182 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:33,183 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:33,183 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:33,183 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,183 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:33,184 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,184 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:33,184 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:33,185 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,187 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:33,189 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:33,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:33,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:33,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,189 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:33,190 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:33,290 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:33,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:33,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:33,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:33,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,297 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:33,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:33,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:33,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:33,298 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,298 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,303 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,303 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:33,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:33,303 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,303 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,304 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,305 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:33,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:33,305 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:33,305 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:33,305 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:33,305 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:33,318 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f79ab51cd8164dd9a3098a21eea36878 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f79ab51cd8164dd9a3098a21eea36878 2023-02-10 07:54:33,724 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/73619815742045f88fdc9363d9b7c7fc 2023-02-10 07:54:33,729 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/73619815742045f88fdc9363d9b7c7fc as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/73619815742045f88fdc9363d9b7c7fc 2023-02-10 07:54:33,734 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/73619815742045f88fdc9363d9b7c7fc, entries=1, sequenceid=33, filesize=4.9 K 2023-02-10 07:54:33,735 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 430ms, sequenceid=33, compaction requested=true 2023-02-10 07:54:33,735 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:33,735 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:33,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:33,737 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,737 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:33,737 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,737 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:33,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:33,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:33,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4566dfb1[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:33,739 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:33,739 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,740 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,740 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:33,740 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:33,740 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:33,740 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,740 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:33,742 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,742 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:33,742 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:33,742 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:33,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:33,744 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:33,745 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:33,745 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:33,745 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,745 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:33,747 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,747 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,747 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:33,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:33,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:33,748 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,749 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,752 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,752 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:33,752 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,752 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:33,752 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:33,752 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:33,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:33,752 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,752 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,752 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,753 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,753 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:33,753 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:33,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:33,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:33,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:33,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:33,853 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:33,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:33,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:33,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:33,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,859 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:33,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:33,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:33,859 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:33,860 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,860 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,861 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,861 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:33,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:33,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:33,861 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:33,861 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:33,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:33,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,862 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,862 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:33,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:33,862 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:33,862 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:33,862 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:33,863 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:33,863 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:33,863 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:33,863 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:33,863 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:34,276 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075c253ceb554e4980973afa55c1cb27d7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509075c253ceb554e4980973afa55c1cb27d7 2023-02-10 07:54:34,685 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/9fd937a80ee64b70983b898dbdd5d44b 2023-02-10 07:54:34,690 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/9fd937a80ee64b70983b898dbdd5d44b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/9fd937a80ee64b70983b898dbdd5d44b 2023-02-10 07:54:34,694 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/9fd937a80ee64b70983b898dbdd5d44b, entries=1, sequenceid=37, filesize=4.9 K 2023-02-10 07:54:34,695 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 832ms, sequenceid=37, compaction requested=true 2023-02-10 07:54:34,695 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:34,695 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:34,697 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,697 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:34,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:34,697 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,697 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:34,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:34,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:34,699 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:34,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73101cfd[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:34,699 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,701 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:34,701 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,701 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:34,703 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,703 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:34,703 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:34,703 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:34,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:34,705 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:34,705 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:34,705 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:34,705 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,705 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:34,706 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,706 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:34,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,707 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:34,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:34,707 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:34,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,708 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:34,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:34,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:34,711 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:34,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:34,711 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:34,711 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:34,711 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:34,711 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:34,711 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,711 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:34,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:34,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:34,711 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,711 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,811 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:34,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:34,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:34,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:34,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,818 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:34,818 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:34,818 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-10 07:54:34,818 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-10 07:54:34,818 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,818 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,821 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:34,821 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:34,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:34,821 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:34,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,821 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:34,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:34,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,822 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,822 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-10 07:54:34,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:34,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-10 07:54:34,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:34,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-10 07:54:34,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:34,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:34,822 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:34,822 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. started... 2023-02-10 07:54:34,822 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ecc368e2d160c410bd4b78c7b4016997 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:35,235 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b573ba9e19d84eb58fbfd5a5bf9c5d64 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120b573ba9e19d84eb58fbfd5a5bf9c5d64 2023-02-10 07:54:35,640 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/f89550e226ad4941950157560bafc18c 2023-02-10 07:54:35,645 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/f89550e226ad4941950157560bafc18c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f89550e226ad4941950157560bafc18c 2023-02-10 07:54:35,649 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f89550e226ad4941950157560bafc18c, entries=1, sequenceid=41, filesize=4.9 K 2023-02-10 07:54:35,650 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ecc368e2d160c410bd4b78c7b4016997 in 828ms, sequenceid=41, compaction requested=true 2023-02-10 07:54:35,650 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:35,650 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:35,650 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:35,650 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:35,650 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,650 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-10 07:54:35,650 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-10 07:54:35,651 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,651 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:35,652 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,652 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:35,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-10 07:54:35,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d41130[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:35,653 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-10 07:54:35,653 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,654 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,654 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-10 07:54:35,654 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-10 07:54:35,654 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:35,654 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,654 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:35,655 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,655 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-10 07:54:35,655 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:35,655 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-10 07:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:54:35,657 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-10 07:54:35,657 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:35,657 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:35,657 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,657 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:35,660 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,660 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:35,660 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:35,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:35,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:35,660 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,661 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:35,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:35,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-10 07:54:35,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-10 07:54:35,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:35,666 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:35,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,666 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:35,667 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:35,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:35,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:35,767 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:35,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:35,769 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-10 07:54:35,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:35,771 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:35,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:35,772 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016275772 2023-02-10 07:54:35,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:54:35,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-10 07:54:35,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:35,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x7584b266 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:54:35,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63a426fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:54:35,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,621 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010398e33f7611bc4804b03aaa7afdb667f0 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010398e33f7611bc4804b03aaa7afdb667f0 2023-02-10 07:54:36,622 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:36,634 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:54:36,636 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50508, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:54:36,641 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:54:36,642 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56066, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:54:36,650 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/31cfc01718ab463abab34756175fb9d3 first=Optional[r3] last=Optional[r6] 2023-02-10 07:54:36,650 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/31cfc01718ab463abab34756175fb9d3}] 2023-02-10 07:54:36,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/31cfc01718ab463abab34756175fb9d3 for inclusion in ecc368e2d160c410bd4b78c7b4016997/family1 2023-02-10 07:54:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-10 07:54:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:36,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/31cfc01718ab463abab34756175fb9d3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kb74kc44f7s20k7l28epm2cqedcbluvkogjnh1u77ff09qriqk4esjae7usfn08e/family1/31cfc01718ab463abab34756175fb9d3 2023-02-10 07:54:36,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kb74kc44f7s20k7l28epm2cqedcbluvkogjnh1u77ff09qriqk4esjae7usfn08e/family1/31cfc01718ab463abab34756175fb9d3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/04add04363c349eb92a93b4c8bc3a214_SeqId_44_ 2023-02-10 07:54:36,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kb74kc44f7s20k7l28epm2cqedcbluvkogjnh1u77ff09qriqk4esjae7usfn08e/family1/31cfc01718ab463abab34756175fb9d3 into ecc368e2d160c410bd4b78c7b4016997/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/04add04363c349eb92a93b4c8bc3a214_SeqId_44_ - updating store file list. 2023-02-10 07:54:36,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/04add04363c349eb92a93b4c8bc3a214_SeqId_44_ into ecc368e2d160c410bd4b78c7b4016997/family1 2023-02-10 07:54:36,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kb74kc44f7s20k7l28epm2cqedcbluvkogjnh1u77ff09qriqk4esjae7usfn08e/family1/31cfc01718ab463abab34756175fb9d3 into ecc368e2d160c410bd4b78c7b4016997/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/04add04363c349eb92a93b4c8bc3a214_SeqId_44_) 2023-02-10 07:54:36,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kb74kc44f7s20k7l28epm2cqedcbluvkogjnh1u77ff09qriqk4esjae7usfn08e/family1/31cfc01718ab463abab34756175fb9d3 2023-02-10 07:54:36,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-10 07:54:36,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-10 07:54:36,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): ecc368e2d160c410bd4b78c7b4016997/family1 is initiating minor compaction 2023-02-10 07:54:36,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@248af8c7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:36,668 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of ecc368e2d160c410bd4b78c7b4016997/family1 in testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:36,668 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/e3cf6bb7082447a99ecc3908fc3e6e31, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/8611c31023444fe68f76e86a339a237f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f87d3ce989274173a5cd1a30dbe46d0f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/925923c282ff4644a15b15c599353392, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/a00d5086d56940b29bd91d84b5d5fc7d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/337cbb7478274c368c08286ed80a2218, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/73619815742045f88fdc9363d9b7c7fc, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/9fd937a80ee64b70983b898dbdd5d44b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f89550e226ad4941950157560bafc18c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/04add04363c349eb92a93b4c8bc3a214_SeqId_44_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp, totalSize=50.0 K 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting e3cf6bb7082447a99ecc3908fc3e6e31, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 8611c31023444fe68f76e86a339a237f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting f87d3ce989274173a5cd1a30dbe46d0f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 925923c282ff4644a15b15c599353392, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting a00d5086d56940b29bd91d84b5d5fc7d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 337cbb7478274c368c08286ed80a2218, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 73619815742045f88fdc9363d9b7c7fc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 9fd937a80ee64b70983b898dbdd5d44b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-10 07:54:36,668 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting f89550e226ad4941950157560bafc18c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-10 07:54:36,669 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 04add04363c349eb92a93b4c8bc3a214_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-10 07:54:36,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:36,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:36,672 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512284ed56d6cd02542a9992036caada9093e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512284ed56d6cd02542a9992036caada9093e 2023-02-10 07:54:36,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512318275581b18e6499fa3038d8b0881bacf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512318275581b18e6499fa3038d8b0881bacf 2023-02-10 07:54:36,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010180ac36749b2d4817a734a0e5cfc51d47 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010180ac36749b2d4817a734a0e5cfc51d47 2023-02-10 07:54:36,676 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f79ab51cd8164dd9a3098a21eea36878 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103f79ab51cd8164dd9a3098a21eea36878 2023-02-10 07:54:36,676 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-10 07:54:36,676 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-10 07:54:36,676 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:36,712 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): ecc368e2d160c410bd4b78c7b4016997#family1#compaction#49 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:37,527 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/b485603f65f349caa50ece85d587548f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/b485603f65f349caa50ece85d587548f 2023-02-10 07:54:37,531 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ecc368e2d160c410bd4b78c7b4016997/family1 of ecc368e2d160c410bd4b78c7b4016997 into b485603f65f349caa50ece85d587548f(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:54:37,532 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:37,533 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676015676667; duration=0sec 2023-02-10 07:54:37,533 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:37,536 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051d697d6612be45a8a8b14da9451c3fb3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051d697d6612be45a8a8b14da9451c3fb3 2023-02-10 07:54:37,537 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:37,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/e3cf6bb7082447a99ecc3908fc3e6e31, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/8611c31023444fe68f76e86a339a237f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f87d3ce989274173a5cd1a30dbe46d0f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/925923c282ff4644a15b15c599353392, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/a00d5086d56940b29bd91d84b5d5fc7d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/337cbb7478274c368c08286ed80a2218, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/73619815742045f88fdc9363d9b7c7fc, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/9fd937a80ee64b70983b898dbdd5d44b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f89550e226ad4941950157560bafc18c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/04add04363c349eb92a93b4c8bc3a214_SeqId_44_] to archive 2023-02-10 07:54:37,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:37,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/e3cf6bb7082447a99ecc3908fc3e6e31 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/e3cf6bb7082447a99ecc3908fc3e6e31 2023-02-10 07:54:37,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/8611c31023444fe68f76e86a339a237f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/8611c31023444fe68f76e86a339a237f 2023-02-10 07:54:37,568 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7413637f1839463a839ac65c6fda8e70 first=Optional[r00] last=Optional[r2] 2023-02-10 07:54:37,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f87d3ce989274173a5cd1a30dbe46d0f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f87d3ce989274173a5cd1a30dbe46d0f 2023-02-10 07:54:37,569 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7413637f1839463a839ac65c6fda8e70}] 2023-02-10 07:54:37,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/925923c282ff4644a15b15c599353392 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/925923c282ff4644a15b15c599353392 2023-02-10 07:54:37,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7413637f1839463a839ac65c6fda8e70 for inclusion in ecc368e2d160c410bd4b78c7b4016997/family1 2023-02-10 07:54:37,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/a00d5086d56940b29bd91d84b5d5fc7d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/a00d5086d56940b29bd91d84b5d5fc7d 2023-02-10 07:54:37,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/337cbb7478274c368c08286ed80a2218 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/337cbb7478274c368c08286ed80a2218 2023-02-10 07:54:37,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-10 07:54:37,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:37,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:37,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/73619815742045f88fdc9363d9b7c7fc to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/73619815742045f88fdc9363d9b7c7fc 2023-02-10 07:54:37,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7413637f1839463a839ac65c6fda8e70 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fim0945enk12gn23q5gp7ig2sqqngi1fvdpf2698j1b7rae2fndqq3jqf05ij0gm/family1/7413637f1839463a839ac65c6fda8e70 2023-02-10 07:54:37,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/9fd937a80ee64b70983b898dbdd5d44b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/9fd937a80ee64b70983b898dbdd5d44b 2023-02-10 07:54:37,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fim0945enk12gn23q5gp7ig2sqqngi1fvdpf2698j1b7rae2fndqq3jqf05ij0gm/family1/7413637f1839463a839ac65c6fda8e70 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/55787c13270946ceb46781debf1cc556_SeqId_47_ 2023-02-10 07:54:37,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f89550e226ad4941950157560bafc18c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/f89550e226ad4941950157560bafc18c 2023-02-10 07:54:37,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fim0945enk12gn23q5gp7ig2sqqngi1fvdpf2698j1b7rae2fndqq3jqf05ij0gm/family1/7413637f1839463a839ac65c6fda8e70 into ecc368e2d160c410bd4b78c7b4016997/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/55787c13270946ceb46781debf1cc556_SeqId_47_ - updating store file list. 2023-02-10 07:54:37,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/04add04363c349eb92a93b4c8bc3a214_SeqId_44_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/04add04363c349eb92a93b4c8bc3a214_SeqId_44_ 2023-02-10 07:54:37,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/55787c13270946ceb46781debf1cc556_SeqId_47_ into ecc368e2d160c410bd4b78c7b4016997/family1 2023-02-10 07:54:37,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fim0945enk12gn23q5gp7ig2sqqngi1fvdpf2698j1b7rae2fndqq3jqf05ij0gm/family1/7413637f1839463a839ac65c6fda8e70 into ecc368e2d160c410bd4b78c7b4016997/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/55787c13270946ceb46781debf1cc556_SeqId_47_) 2023-02-10 07:54:37,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fim0945enk12gn23q5gp7ig2sqqngi1fvdpf2698j1b7rae2fndqq3jqf05ij0gm/family1/7413637f1839463a839ac65c6fda8e70 2023-02-10 07:54:37,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-10 07:54:37,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-10 07:54:37,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): ecc368e2d160c410bd4b78c7b4016997/family1 is initiating minor compaction (all files) 2023-02-10 07:54:37,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@19051d27; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:37,583 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of ecc368e2d160c410bd4b78c7b4016997/family1 in testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:54:37,583 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/6fad0c428ff249db95adaae953f284bb, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/b485603f65f349caa50ece85d587548f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/55787c13270946ceb46781debf1cc556_SeqId_47_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp, totalSize=337.0 K 2023-02-10 07:54:37,584 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 6fad0c428ff249db95adaae953f284bb, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842896 2023-02-10 07:54:37,584 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting b485603f65f349caa50ece85d587548f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242896 2023-02-10 07:54:37,585 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 55787c13270946ceb46781debf1cc556_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842896 2023-02-10 07:54:37,585 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:37,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:37,587 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511303c5ceacd96184330b484e85681753c35 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511303c5ceacd96184330b484e85681753c35 2023-02-10 07:54:37,588 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb8023d324d34b198979d3e1f47db94b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb8023d324d34b198979d3e1f47db94b 2023-02-10 07:54:37,589 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca4c2afe47df453789b45fdbd9c58b74 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca4c2afe47df453789b45fdbd9c58b74 2023-02-10 07:54:37,589 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-10 07:54:37,589 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-10 07:54:37,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-10 07:54:37,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-10 07:54:37,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:37,591 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:54:37,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8210 sec 2023-02-10 07:54:37,600 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): ecc368e2d160c410bd4b78c7b4016997#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:37,684 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=258 (was 249) - Thread LEAK? -, OpenFileDescriptor=623 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 252), ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=3400 (was 3495) 2023-02-10 07:54:37,695 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=258, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=170, AvailableMemoryMB=3399 2023-02-10 07:54:37,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-10 07:54:37,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:37,699 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:54:37,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-10 07:54:37,699 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:54:37,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-10 07:54:37,701 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:37,701 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 empty. 2023-02-10 07:54:37,702 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:37,702 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-10 07:54:37,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-10 07:54:38,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-10 07:54:38,111 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-10 07:54:38,113 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => d67328b9944e1b0543f40d85608b9019, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:54:38,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-10 07:54:38,518 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:38,519 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing d67328b9944e1b0543f40d85608b9019, disabling compactions & flushes 2023-02-10 07:54:38,519 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:38,519 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:38,519 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. after waiting 0 ms 2023-02-10 07:54:38,519 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:38,519 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:38,519 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for d67328b9944e1b0543f40d85608b9019: Waiting for close lock at 1676015678519Disabling compacts and flushes for region at 1676015678519Disabling writes for close at 1676015678519Writing region close event to WAL at 1676015678519Closed at 1676015678519 2023-02-10 07:54:38,521 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:54:38,522 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015678522"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015678522"}]},"ts":"1676015678522"} 2023-02-10 07:54:38,524 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:54:38,525 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:54:38,525 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015678525"}]},"ts":"1676015678525"} 2023-02-10 07:54:38,526 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-10 07:54:38,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, ASSIGN}] 2023-02-10 07:54:38,530 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, ASSIGN 2023-02-10 07:54:38,531 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:54:38,682 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:38,683 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015678682"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015678682"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015678682"}]},"ts":"1676015678682"} 2023-02-10 07:54:38,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:38,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-10 07:54:38,823 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/.tmp/family1/7f5b26585c3e4340a39c58c5b35ddb9c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/7f5b26585c3e4340a39c58c5b35ddb9c 2023-02-10 07:54:38,828 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ecc368e2d160c410bd4b78c7b4016997/family1 of ecc368e2d160c410bd4b78c7b4016997 into 7f5b26585c3e4340a39c58c5b35ddb9c(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:54:38,828 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for ecc368e2d160c410bd4b78c7b4016997: 2023-02-10 07:54:38,828 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676015677583; duration=1sec 2023-02-10 07:54:38,828 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:38,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:38,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d67328b9944e1b0543f40d85608b9019, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:54:38,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:38,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:38,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:38,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:38,840 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:38,841 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:38,841 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:38,841 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d67328b9944e1b0543f40d85608b9019 columnFamilyName family1 2023-02-10 07:54:38,843 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(310): Store=d67328b9944e1b0543f40d85608b9019/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:38,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:38,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:38,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:38,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:54:38,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d67328b9944e1b0543f40d85608b9019; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69916938, jitterRate=0.041843563318252563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:54:38,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d67328b9944e1b0543f40d85608b9019: Running coprocessor pre-open hook at 1676015678839Writing region info on filesystem at 1676015678839Initializing all the Stores at 1676015678839Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676015678839Cleaning up temporary data from old regions at 1676015678844 (+5 ms)Cleaning up detritus from prior splits at 1676015678845 (+1 ms)Running coprocessor post-open hooks at 1676015678848 (+3 ms)Region opened successfully at 1676015678848 2023-02-10 07:54:38,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019., pid=41, masterSystemTime=1676015678836 2023-02-10 07:54:38,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:38,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:38,851 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:38,851 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015678851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015678851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015678851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015678851"}]},"ts":"1676015678851"} 2023-02-10 07:54:38,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-10 07:54:38,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909 in 168 msec 2023-02-10 07:54:38,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-10 07:54:38,855 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, ASSIGN in 325 msec 2023-02-10 07:54:38,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:54:38,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/6fad0c428ff249db95adaae953f284bb, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/b485603f65f349caa50ece85d587548f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/55787c13270946ceb46781debf1cc556_SeqId_47_] to archive 2023-02-10 07:54:38,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015678859"}]},"ts":"1676015678859"} 2023-02-10 07:54:38,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:38,860 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-10 07:54:38,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/6fad0c428ff249db95adaae953f284bb to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/6fad0c428ff249db95adaae953f284bb 2023-02-10 07:54:38,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:54:38,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/b485603f65f349caa50ece85d587548f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/b485603f65f349caa50ece85d587548f 2023-02-10 07:54:38,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1660 sec 2023-02-10 07:54:38,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/55787c13270946ceb46781debf1cc556_SeqId_47_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/family1/55787c13270946ceb46781debf1cc556_SeqId_47_ 2023-02-10 07:54:39,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-10 07:54:39,805 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-10 07:54:39,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:39,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:39,827 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:39,827 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:39,827 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:39,827 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:39,828 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:39,828 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:39,830 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:39,830 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:39,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:39,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:39,831 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:39,831 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:39,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:39,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:39,831 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:39,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:39,832 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:39,832 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:39,832 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:39,832 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:39,832 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:39,832 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:39,832 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:39,833 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-10 07:54:40,253 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130bead5eec8ec6418599a9c9ae83e2338e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130bead5eec8ec6418599a9c9ae83e2338e 2023-02-10 07:54:40,425 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:40,445 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-10 07:54:40,657 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/68eef00a90a94061b12a70073d5c5a35 2023-02-10 07:54:40,662 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/68eef00a90a94061b12a70073d5c5a35 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/68eef00a90a94061b12a70073d5c5a35 2023-02-10 07:54:40,666 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/68eef00a90a94061b12a70073d5c5a35, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-10 07:54:40,666 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 833ms, sequenceid=5, compaction requested=false 2023-02-10 07:54:40,667 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:40,667 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:40,667 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:40,669 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,669 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:40,669 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,669 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:40,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:40,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@570f44a4[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:40,670 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:40,671 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,672 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,672 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:40,672 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:40,672 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:40,672 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,672 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:40,674 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,674 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:40,674 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:40,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,675 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:40,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:40,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:40,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:40,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:40,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:40,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:40,677 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:40,677 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:40,677 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:40,677 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,677 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:40,678 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,678 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:40,678 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:40,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:40,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:40,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:40,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:40,679 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:40,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,680 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:40,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:40,682 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:40,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-10 07:54:40,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:40,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:40,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,682 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:40,683 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:40,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:40,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:40,783 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:40,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:40,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:40,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,789 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:40,789 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:40,789 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:40,789 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:40,789 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,789 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,790 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:40,790 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:40,791 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:40,791 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,791 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,792 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-10 07:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:40,792 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:40,792 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:40,792 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:40,792 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-10 07:54:41,206 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282d20e433787543c6b6526d76073af5cf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282d20e433787543c6b6526d76073af5cf 2023-02-10 07:54:41,611 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/df7bf1b4db784904a898572e492daa2e 2023-02-10 07:54:41,618 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/df7bf1b4db784904a898572e492daa2e as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/df7bf1b4db784904a898572e492daa2e 2023-02-10 07:54:41,622 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/df7bf1b4db784904a898572e492daa2e, entries=1, sequenceid=9, filesize=5.0 K 2023-02-10 07:54:41,622 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 830ms, sequenceid=9, compaction requested=false 2023-02-10 07:54:41,622 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:41,622 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:41,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:41,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:41,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:41,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:41,624 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,624 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:41,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:41,625 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:41,625 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:41,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:41,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@246792a3[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:41,626 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:41,626 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,627 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,627 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:41,627 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:41,627 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:41,627 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,628 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:41,629 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:41,629 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:41,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:41,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:41,631 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:41,631 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:41,631 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:41,631 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,631 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:41,634 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,634 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:41,634 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:41,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:41,634 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:41,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,635 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,644 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,644 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:41,644 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,644 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:41,644 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:41,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:41,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:41,644 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:41,645 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,645 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,645 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:41,645 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:41,645 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:41,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:41,645 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,745 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:41,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:41,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:41,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:41,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,751 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:41,751 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:41,751 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:41,751 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:41,752 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,752 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,753 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,753 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:41,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:41,753 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:41,753 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:41,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:41,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-10 07:54:41,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:41,754 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:41,755 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:41,755 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:41,755 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:41,755 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:41,755 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:41,755 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:41,756 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:42,169 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017b7c5acf9dc84fe7bde760f5b714eae8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017b7c5acf9dc84fe7bde760f5b714eae8 2023-02-10 07:54:42,575 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/076f9eb26b1e459eb1157ebe9843d536 2023-02-10 07:54:42,579 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/076f9eb26b1e459eb1157ebe9843d536 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/076f9eb26b1e459eb1157ebe9843d536 2023-02-10 07:54:42,583 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/076f9eb26b1e459eb1157ebe9843d536, entries=1, sequenceid=13, filesize=5.0 K 2023-02-10 07:54:42,584 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 828ms, sequenceid=13, compaction requested=true 2023-02-10 07:54:42,584 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:42,584 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:42,584 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:42,584 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:42,584 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,584 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:42,585 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:42,587 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,587 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:42,587 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,587 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:42,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:42,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57639526[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:42,589 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:42,589 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,590 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:42,590 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,590 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:42,591 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,591 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:42,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:42,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:42,591 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:42,592 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:42,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:42,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:42,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:42,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:42,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:42,594 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:42,594 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:42,594 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:42,594 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,594 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:42,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:42,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:42,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:42,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:42,596 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,597 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,616 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:54:42,617 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7584b266 to 127.0.0.1:54857 2023-02-10 07:54:42,617 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:54:42,620 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:54:42,620 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dff75b3 to 127.0.0.1:54857 2023-02-10 07:54:42,620 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:54:42,622 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:54:42,622 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c87b3c0 to 127.0.0.1:54857 2023-02-10 07:54:42,622 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,622 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:54:42,622 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,622 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,622 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,622 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,622 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,622 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,622 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:42,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-10 07:54:42,624 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:42,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:42,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:42,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:42,624 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:42,625 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:42,625 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:42,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:42,725 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:42,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:42,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:42,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:42,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,732 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:42,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:42,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:42,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:42,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,732 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,734 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,734 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:42,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:42,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:42,734 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:42,734 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:42,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:42,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:42,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:42,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:42,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:42,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:42,735 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:42,735 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:42,735 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:42,735 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:43,147 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205119a499592bf4bf8beabe80d95663c2c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205119a499592bf4bf8beabe80d95663c2c 2023-02-10 07:54:43,553 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/0d2cb66f67104ef8977914e76d401a3c 2023-02-10 07:54:43,558 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/0d2cb66f67104ef8977914e76d401a3c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/0d2cb66f67104ef8977914e76d401a3c 2023-02-10 07:54:43,562 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/0d2cb66f67104ef8977914e76d401a3c, entries=1, sequenceid=17, filesize=5.0 K 2023-02-10 07:54:43,562 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 827ms, sequenceid=17, compaction requested=true 2023-02-10 07:54:43,562 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:43,563 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:43,563 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:43,563 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:43,563 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,563 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:43,563 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:43,565 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,565 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:43,566 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,566 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:43,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:43,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@779e436b[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:43,567 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:43,567 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,568 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,568 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:43,568 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:43,568 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,569 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:43,570 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:43,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:43,572 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:43,572 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:43,572 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:43,572 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,572 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:43,573 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,573 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,574 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:43,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:43,574 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,575 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,578 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,578 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,578 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:43,578 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:43,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:43,579 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:43,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-10 07:54:43,579 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:43,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:43,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:43,579 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,579 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:43,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:43,579 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,579 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,579 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:43,579 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:43,679 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:43,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:43,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:43,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:43,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,686 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:43,686 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:43,686 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:43,686 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:43,686 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,686 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,687 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:43,687 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:43,687 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:43,687 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,688 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,688 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-10 07:54:43,688 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:43,688 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:43,688 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:43,689 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:43,689 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:43,689 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:44,100 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122846da458e65ef4de795b22e0178e72da7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122846da458e65ef4de795b22e0178e72da7 2023-02-10 07:54:44,368 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:54:44,506 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/33a16acc2c904a429d8c53947c61aeff 2023-02-10 07:54:44,510 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/33a16acc2c904a429d8c53947c61aeff as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/33a16acc2c904a429d8c53947c61aeff 2023-02-10 07:54:44,514 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/33a16acc2c904a429d8c53947c61aeff, entries=1, sequenceid=21, filesize=5.0 K 2023-02-10 07:54:44,515 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 826ms, sequenceid=21, compaction requested=true 2023-02-10 07:54:44,515 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:44,515 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:44,520 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:44,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:44,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a190358[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:44,521 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:44,521 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,524 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:44,524 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,524 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:44,525 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,525 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:44,525 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:44,525 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:44,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:44,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:44,527 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:44,527 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:44,527 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:44,527 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,527 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:44,528 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,528 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:44,528 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:44,529 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,530 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,532 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,532 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,532 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:44,532 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:44,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:44,532 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:44,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-10 07:54:44,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:44,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:44,532 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,533 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,533 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,533 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,533 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,533 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:44,533 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:44,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:44,633 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:44,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:44,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:44,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:44,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,639 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:44,639 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:44,639 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:44,639 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:44,640 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,640 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,642 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:44,642 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:44,642 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:44,642 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:44,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,643 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,643 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-10 07:54:44,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:44,643 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:44,643 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:44,643 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:44,643 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:44,643 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:44,643 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:44,643 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:44,644 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:45,055 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311ebc03816d6f44738dd14f0278abcda2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311ebc03816d6f44738dd14f0278abcda2 2023-02-10 07:54:45,461 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/cd30badbf7ba4a68aea43fec393972bd 2023-02-10 07:54:45,466 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/cd30badbf7ba4a68aea43fec393972bd as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/cd30badbf7ba4a68aea43fec393972bd 2023-02-10 07:54:45,470 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/cd30badbf7ba4a68aea43fec393972bd, entries=1, sequenceid=25, filesize=5.0 K 2023-02-10 07:54:45,471 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 828ms, sequenceid=25, compaction requested=true 2023-02-10 07:54:45,471 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:45,471 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:45,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:45,473 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,473 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:45,473 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,473 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:45,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:45,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:45,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42f36032[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:45,474 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:45,474 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,475 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:45,476 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,476 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:45,477 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:45,477 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,477 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:45,477 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:45,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:45,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:45,480 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:45,480 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:45,480 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:45,480 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,480 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:45,486 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,486 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:45,486 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:45,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:45,487 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,488 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:45,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:45,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:45,490 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:45,490 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,491 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:45,591 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:45,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:45,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:45,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:45,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,597 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:45,597 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:45,597 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:45,597 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:45,597 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,597 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,598 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,598 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:45,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:45,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:45,598 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:45,598 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,599 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,599 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-10 07:54:45,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:45,599 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:45,599 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:45,599 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:45,600 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:45,600 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:45,600 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:45,600 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:45,600 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:46,011 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c17bba10586f4f3882754effac6c29b4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c17bba10586f4f3882754effac6c29b4 2023-02-10 07:54:46,417 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/20b46a5069d0462393bd56885df848f9 2023-02-10 07:54:46,422 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/20b46a5069d0462393bd56885df848f9 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/20b46a5069d0462393bd56885df848f9 2023-02-10 07:54:46,426 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/20b46a5069d0462393bd56885df848f9, entries=1, sequenceid=29, filesize=5.0 K 2023-02-10 07:54:46,427 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 827ms, sequenceid=29, compaction requested=true 2023-02-10 07:54:46,427 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:46,427 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:46,427 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:46,428 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,428 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:46,429 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,429 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:46,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:46,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f217ef[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:46,430 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:46,430 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,432 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,432 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:46,432 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:46,432 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:46,432 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,433 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:46,434 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:46,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,434 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:46,434 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:46,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:46,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:46,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:46,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:46,436 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:46,436 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:46,436 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:46,436 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,436 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:46,440 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,440 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,440 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:46,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:46,441 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,442 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,445 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:46,445 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,445 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:46,445 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:46,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:46,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:46,445 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:46,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:46,446 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,446 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,446 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,446 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,446 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,446 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:46,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:46,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:46,446 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:46,546 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:46,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:46,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:46,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,552 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:46,552 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:46,552 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:46,552 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:46,553 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,553 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,554 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:46,554 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:46,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:46,554 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:46,554 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:46,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:46,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,555 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,555 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-10 07:54:46,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:46,555 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:46,556 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:46,556 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:46,556 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:46,969 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a04f711b67fa48048cce09ba35ef3af4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a04f711b67fa48048cce09ba35ef3af4 2023-02-10 07:54:47,375 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/1ba975ee99354956bf8e94b6e2bf995b 2023-02-10 07:54:47,379 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/1ba975ee99354956bf8e94b6e2bf995b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/1ba975ee99354956bf8e94b6e2bf995b 2023-02-10 07:54:47,383 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/1ba975ee99354956bf8e94b6e2bf995b, entries=1, sequenceid=33, filesize=5.0 K 2023-02-10 07:54:47,384 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 828ms, sequenceid=33, compaction requested=true 2023-02-10 07:54:47,384 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:47,384 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:47,384 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,385 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:47,385 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,386 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:47,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,386 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:47,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:47,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cf288a1[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:47,388 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:47,388 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,389 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:47,389 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,389 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:47,392 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,392 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:47,392 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:47,392 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:47,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:47,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:47,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:47,394 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:47,394 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:47,394 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:47,394 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,394 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:47,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:47,395 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:47,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:47,396 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,397 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,399 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,399 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,399 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:47,400 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,400 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:47,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:47,400 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:47,400 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,400 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,400 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,400 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:47,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-10 07:54:47,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:47,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:47,400 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:47,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:47,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:47,400 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:47,501 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:47,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:47,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:47,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:47,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,507 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:47,507 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:47,507 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:47,507 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:47,507 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,507 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,508 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,508 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:47,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:47,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:47,509 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:47,509 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:47,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,509 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,509 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-10 07:54:47,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:47,510 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:47,510 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:47,510 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:47,510 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:47,510 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:47,510 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:47,510 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:47,510 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:47,923 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070f4dea15511b4a5db08b1b79072d5356 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509070f4dea15511b4a5db08b1b79072d5356 2023-02-10 07:54:48,328 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/ab9f1e56d5c740c9bb06fd66f4c070d7 2023-02-10 07:54:48,333 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/ab9f1e56d5c740c9bb06fd66f4c070d7 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/ab9f1e56d5c740c9bb06fd66f4c070d7 2023-02-10 07:54:48,337 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/ab9f1e56d5c740c9bb06fd66f4c070d7, entries=1, sequenceid=37, filesize=5.0 K 2023-02-10 07:54:48,338 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 828ms, sequenceid=37, compaction requested=true 2023-02-10 07:54:48,338 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:48,338 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:48,338 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:48,340 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,340 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:48,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:48,341 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,341 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:48,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:48,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ee359a4[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:48,342 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:48,342 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,343 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,343 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:48,343 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:48,343 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,343 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:48,343 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:48,345 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,345 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:48,345 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:48,345 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:48,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:48,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:48,347 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:48,347 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:48,347 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:48,347 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,347 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:48,348 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,348 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:48,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,348 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:48,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:48,349 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:48,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:48,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:48,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,350 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:48,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,355 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,355 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,355 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,355 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:48,355 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:48,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:48,355 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,355 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:48,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-10 07:54:48,355 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:48,355 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:48,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:48,356 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,356 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:48,356 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:48,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:48,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:48,456 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:48,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:48,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:48,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:48,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,463 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:48,463 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:48,463 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-10 07:54:48,463 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-10 07:54:48,463 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,463 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,464 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,464 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:48,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:48,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:48,465 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:48,465 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:48,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,465 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:48,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,465 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,466 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-10 07:54:48,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:48,466 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-10 07:54:48,466 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:48,466 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-10 07:54:48,466 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:48,466 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:48,466 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:48,466 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. started... 2023-02-10 07:54:48,466 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d67328b9944e1b0543f40d85608b9019 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:48,878 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120605b80049d894942bce3c8e62a861f76 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120605b80049d894942bce3c8e62a861f76 2023-02-10 07:54:49,283 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/8c423af659554eb8b88b3b06670324d9 2023-02-10 07:54:49,288 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/8c423af659554eb8b88b3b06670324d9 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8c423af659554eb8b88b3b06670324d9 2023-02-10 07:54:49,291 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8c423af659554eb8b88b3b06670324d9, entries=1, sequenceid=41, filesize=5.0 K 2023-02-10 07:54:49,292 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d67328b9944e1b0543f40d85608b9019 in 826ms, sequenceid=41, compaction requested=true 2023-02-10 07:54:49,292 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:49,292 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:49,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:49,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:49,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-10 07:54:49,292 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-10 07:54:49,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,294 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:49,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:49,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:49,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-10 07:54:49,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@474848ba[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:49,296 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-10 07:54:49,296 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,297 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-10 07:54:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-10 07:54:49,297 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:49,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,297 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:49,299 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-10 07:54:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:49,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:49,300 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-10 07:54:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:49,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-10 07:54:49,302 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-10 07:54:49,302 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:49,302 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:49,302 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,302 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:49,303 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,303 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:49,303 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:49,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:49,304 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:49,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,305 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:49,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:49,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:49,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:49,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-10 07:54:49,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:49,307 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:49,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,307 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:49,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:49,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:49,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:49,308 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:49,308 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:49,408 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:49,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:49,410 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:49,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:49,412 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:49,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:49,413 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016289413 2023-02-10 07:54:49,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:54:49,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-10 07:54:49,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:49,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x520b088d to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:54:49,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c7c64ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:54:49,420 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,257 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010338ab926d6052411986234469c0fc5217 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010338ab926d6052411986234469c0fc5217 2023-02-10 07:54:50,258 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:50,270 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:54:50,271 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43296, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:54:50,278 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:54:50,279 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59602, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:54:50,287 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/557610b1fb8549ca94be802f7d2215cb first=Optional[r3] last=Optional[r6] 2023-02-10 07:54:50,287 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/557610b1fb8549ca94be802f7d2215cb}] 2023-02-10 07:54:50,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/557610b1fb8549ca94be802f7d2215cb for inclusion in d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:50,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-10 07:54:50,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:50,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:50,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/557610b1fb8549ca94be802f7d2215cb to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bjql0gca0jv7fjgc8gu9emrmer0frh6e0mqgip95nfbtnl1g42aca71m5oq1g0vd/family1/557610b1fb8549ca94be802f7d2215cb 2023-02-10 07:54:50,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bjql0gca0jv7fjgc8gu9emrmer0frh6e0mqgip95nfbtnl1g42aca71m5oq1g0vd/family1/557610b1fb8549ca94be802f7d2215cb as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_ 2023-02-10 07:54:50,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bjql0gca0jv7fjgc8gu9emrmer0frh6e0mqgip95nfbtnl1g42aca71m5oq1g0vd/family1/557610b1fb8549ca94be802f7d2215cb into d67328b9944e1b0543f40d85608b9019/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_ - updating store file list. 2023-02-10 07:54:50,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_ into d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:50,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bjql0gca0jv7fjgc8gu9emrmer0frh6e0mqgip95nfbtnl1g42aca71m5oq1g0vd/family1/557610b1fb8549ca94be802f7d2215cb into d67328b9944e1b0543f40d85608b9019/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_) 2023-02-10 07:54:50,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__bjql0gca0jv7fjgc8gu9emrmer0frh6e0mqgip95nfbtnl1g42aca71m5oq1g0vd/family1/557610b1fb8549ca94be802f7d2215cb 2023-02-10 07:54:50,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-10 07:54:50,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-10 07:54:50,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): d67328b9944e1b0543f40d85608b9019/family1 is initiating minor compaction 2023-02-10 07:54:50,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@332bfeb6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:50,304 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of d67328b9944e1b0543f40d85608b9019/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:50,304 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/df7bf1b4db784904a898572e492daa2e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/076f9eb26b1e459eb1157ebe9843d536, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/0d2cb66f67104ef8977914e76d401a3c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/33a16acc2c904a429d8c53947c61aeff, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/cd30badbf7ba4a68aea43fec393972bd, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/20b46a5069d0462393bd56885df848f9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/1ba975ee99354956bf8e94b6e2bf995b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/ab9f1e56d5c740c9bb06fd66f4c070d7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8c423af659554eb8b88b3b06670324d9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp, totalSize=50.4 K 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting df7bf1b4db784904a898572e492daa2e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 076f9eb26b1e459eb1157ebe9843d536, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0d2cb66f67104ef8977914e76d401a3c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 33a16acc2c904a429d8c53947c61aeff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting cd30badbf7ba4a68aea43fec393972bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 20b46a5069d0462393bd56885df848f9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 1ba975ee99354956bf8e94b6e2bf995b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting ab9f1e56d5c740c9bb06fd66f4c070d7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 8c423af659554eb8b88b3b06670324d9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-10 07:54:50,305 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-10 07:54:50,306 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:50,307 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:50,308 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122846da458e65ef4de795b22e0178e72da7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122846da458e65ef4de795b22e0178e72da7 2023-02-10 07:54:50,310 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311ebc03816d6f44738dd14f0278abcda2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512311ebc03816d6f44738dd14f0278abcda2 2023-02-10 07:54:50,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c17bba10586f4f3882754effac6c29b4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101c17bba10586f4f3882754effac6c29b4 2023-02-10 07:54:50,312 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a04f711b67fa48048cce09ba35ef3af4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a04f711b67fa48048cce09ba35ef3af4 2023-02-10 07:54:50,312 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-10 07:54:50,312 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-10 07:54:50,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,332 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): d67328b9944e1b0543f40d85608b9019#family1#compaction#61 average throughput is 0.32 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:50,756 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/a211dd74fff64827bedf184e14a0b7ee as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/a211dd74fff64827bedf184e14a0b7ee 2023-02-10 07:54:50,759 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120512dc3b7c7cc34bdbb36a74d46c98b433 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120512dc3b7c7cc34bdbb36a74d46c98b433 2023-02-10 07:54:50,760 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:50,761 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d67328b9944e1b0543f40d85608b9019/family1 of d67328b9944e1b0543f40d85608b9019 into a211dd74fff64827bedf184e14a0b7ee(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:54:50,762 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:50,762 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676015690304; duration=0sec 2023-02-10 07:54:50,762 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:50,787 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7735239ebe584a608593c193d5774d78 first=Optional[r00] last=Optional[r2] 2023-02-10 07:54:50,788 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7735239ebe584a608593c193d5774d78}] 2023-02-10 07:54:50,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7735239ebe584a608593c193d5774d78 for inclusion in d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:50,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-10 07:54:50,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:50,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:50,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7735239ebe584a608593c193d5774d78 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5ll76632qvaq5l3idpq8j5sentnve2n5dpp02bnm1hvq543bb7qhsp6494drt3h4/family1/7735239ebe584a608593c193d5774d78 2023-02-10 07:54:50,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5ll76632qvaq5l3idpq8j5sentnve2n5dpp02bnm1hvq543bb7qhsp6494drt3h4/family1/7735239ebe584a608593c193d5774d78 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_ 2023-02-10 07:54:50,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5ll76632qvaq5l3idpq8j5sentnve2n5dpp02bnm1hvq543bb7qhsp6494drt3h4/family1/7735239ebe584a608593c193d5774d78 into d67328b9944e1b0543f40d85608b9019/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_ - updating store file list. 2023-02-10 07:54:50,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_ into d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:50,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5ll76632qvaq5l3idpq8j5sentnve2n5dpp02bnm1hvq543bb7qhsp6494drt3h4/family1/7735239ebe584a608593c193d5774d78 into d67328b9944e1b0543f40d85608b9019/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_) 2023-02-10 07:54:50,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__5ll76632qvaq5l3idpq8j5sentnve2n5dpp02bnm1hvq543bb7qhsp6494drt3h4/family1/7735239ebe584a608593c193d5774d78 2023-02-10 07:54:50,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-10 07:54:50,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-10 07:54:50,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): d67328b9944e1b0543f40d85608b9019/family1 is initiating minor compaction (all files) 2023-02-10 07:54:50,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@70ee64ec; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:50,801 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of d67328b9944e1b0543f40d85608b9019/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:50,801 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/68eef00a90a94061b12a70073d5c5a35, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/a211dd74fff64827bedf184e14a0b7ee, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp, totalSize=390.1 K 2023-02-10 07:54:50,801 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 68eef00a90a94061b12a70073d5c5a35, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842896 2023-02-10 07:54:50,802 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting a211dd74fff64827bedf184e14a0b7ee, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242896 2023-02-10 07:54:50,802 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878842896 2023-02-10 07:54:50,803 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:50,803 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:50,806 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130bead5eec8ec6418599a9c9ae83e2338e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130bead5eec8ec6418599a9c9ae83e2338e 2023-02-10 07:54:50,807 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017b7c5acf9dc84fe7bde760f5b714eae8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017b7c5acf9dc84fe7bde760f5b714eae8 2023-02-10 07:54:50,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205119a499592bf4bf8beabe80d95663c2c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205119a499592bf4bf8beabe80d95663c2c 2023-02-10 07:54:50,808 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-10 07:54:50,808 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-10 07:54:50,809 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:50,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:50,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:50,810 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:50,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.3990 sec 2023-02-10 07:54:50,817 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): d67328b9944e1b0543f40d85608b9019#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:54:50,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/df7bf1b4db784904a898572e492daa2e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/076f9eb26b1e459eb1157ebe9843d536, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/0d2cb66f67104ef8977914e76d401a3c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/33a16acc2c904a429d8c53947c61aeff, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/cd30badbf7ba4a68aea43fec393972bd, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/20b46a5069d0462393bd56885df848f9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/1ba975ee99354956bf8e94b6e2bf995b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/ab9f1e56d5c740c9bb06fd66f4c070d7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8c423af659554eb8b88b3b06670324d9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_] to archive 2023-02-10 07:54:50,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:50,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/df7bf1b4db784904a898572e492daa2e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/df7bf1b4db784904a898572e492daa2e 2023-02-10 07:54:50,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/076f9eb26b1e459eb1157ebe9843d536 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/076f9eb26b1e459eb1157ebe9843d536 2023-02-10 07:54:50,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/0d2cb66f67104ef8977914e76d401a3c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/0d2cb66f67104ef8977914e76d401a3c 2023-02-10 07:54:50,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/33a16acc2c904a429d8c53947c61aeff to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/33a16acc2c904a429d8c53947c61aeff 2023-02-10 07:54:50,869 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/cd30badbf7ba4a68aea43fec393972bd to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/cd30badbf7ba4a68aea43fec393972bd 2023-02-10 07:54:50,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/20b46a5069d0462393bd56885df848f9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/20b46a5069d0462393bd56885df848f9 2023-02-10 07:54:50,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/1ba975ee99354956bf8e94b6e2bf995b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/1ba975ee99354956bf8e94b6e2bf995b 2023-02-10 07:54:50,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/ab9f1e56d5c740c9bb06fd66f4c070d7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/ab9f1e56d5c740c9bb06fd66f4c070d7 2023-02-10 07:54:50,874 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8c423af659554eb8b88b3b06670324d9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8c423af659554eb8b88b3b06670324d9 2023-02-10 07:54:50,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/8d0a1138ad4a435eb4ee006f317b32f8_SeqId_44_ 2023-02-10 07:54:50,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-10 07:54:50,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:51,292 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-10 07:54:51,293 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-10 07:54:51,293 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-10 07:54:51,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-10 07:54:51,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, REOPEN/MOVE}] 2023-02-10 07:54:51,298 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, REOPEN/MOVE 2023-02-10 07:54:51,298 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:51,298 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015691298"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015691298"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015691298"}]},"ts":"1676015691298"} 2023-02-10 07:54:51,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:51,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:51,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d67328b9944e1b0543f40d85608b9019, disabling compactions & flushes 2023-02-10 07:54:51,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:52,035 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/.tmp/family1/545baa5e88b9430e900106ff003adbbb as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/545baa5e88b9430e900106ff003adbbb 2023-02-10 07:54:52,039 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d67328b9944e1b0543f40d85608b9019/family1 of d67328b9944e1b0543f40d85608b9019 into 545baa5e88b9430e900106ff003adbbb(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:54:52,039 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:52,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:52,039 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676015690801; duration=1sec 2023-02-10 07:54:52,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:52,039 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:54:52,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. after waiting 0 ms 2023-02-10 07:54:52,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:52,040 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/68eef00a90a94061b12a70073d5c5a35, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/a211dd74fff64827bedf184e14a0b7ee, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_] to archive 2023-02-10 07:54:52,040 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:52,042 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/68eef00a90a94061b12a70073d5c5a35 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/68eef00a90a94061b12a70073d5c5a35 2023-02-10 07:54:52,043 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/a211dd74fff64827bedf184e14a0b7ee to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/a211dd74fff64827bedf184e14a0b7ee 2023-02-10 07:54:52,044 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/5a575908fe6149dbb4c5e56bf4c400f4_SeqId_47_ 2023-02-10 07:54:52,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-10 07:54:52,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:52,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d67328b9944e1b0543f40d85608b9019: Waiting for close lock at 1676015691451Running coprocessor pre-close hooks at 1676015691451Disabling compacts and flushes for region at 1676015691451Disabling writes for close at 1676015692039 (+588 ms)Writing region close event to WAL at 1676015692046 (+7 ms)Running coprocessor post-close hooks at 1676015692049 (+3 ms)Closed at 1676015692050 (+1 ms) 2023-02-10 07:54:52,050 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: d67328b9944e1b0543f40d85608b9019 to self. 2023-02-10 07:54:52,051 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:52,052 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=CLOSED 2023-02-10 07:54:52,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015692052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015692052"}]},"ts":"1676015692052"} 2023-02-10 07:54:52,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-10 07:54:52,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909 in 753 msec 2023-02-10 07:54:52,055 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=true 2023-02-10 07:54:52,205 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:52,205 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015692205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015692205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015692205"}]},"ts":"1676015692205"} 2023-02-10 07:54:52,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:52,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:52,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d67328b9944e1b0543f40d85608b9019, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:54:52,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:52,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:52,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:52,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:52,362 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:52,363 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:52,363 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:52,364 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d67328b9944e1b0543f40d85608b9019 columnFamilyName family1 2023-02-10 07:54:52,368 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/545baa5e88b9430e900106ff003adbbb 2023-02-10 07:54:52,368 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(310): Store=d67328b9944e1b0543f40d85608b9019/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:52,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:52,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:52,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:52,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d67328b9944e1b0543f40d85608b9019; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61115390, jitterRate=-0.08930972218513489}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:54:52,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d67328b9944e1b0543f40d85608b9019: Running coprocessor pre-open hook at 1676015692361Writing region info on filesystem at 1676015692361Initializing all the Stores at 1676015692362 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676015692362Cleaning up temporary data from old regions at 1676015692370 (+8 ms)Cleaning up detritus from prior splits at 1676015692371 (+1 ms)Running coprocessor post-open hooks at 1676015692373 (+2 ms)Region opened successfully at 1676015692373 2023-02-10 07:54:52,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019., pid=47, masterSystemTime=1676015692358 2023-02-10 07:54:52,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:52,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:52,375 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:52,375 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015692375"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015692375"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015692375"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015692375"}]},"ts":"1676015692375"} 2023-02-10 07:54:52,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-10 07:54:52,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909 in 170 msec 2023-02-10 07:54:52,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-10 07:54:52,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, REOPEN/MOVE in 1.0810 sec 2023-02-10 07:54:52,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-10 07:54:52,381 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0840 sec 2023-02-10 07:54:52,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4990 sec 2023-02-10 07:54:52,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-10 07:54:52,384 INFO [Listener at localhost/46793] compactions.TestMobCompactor(278): alter status finished 2023-02-10 07:54:52,384 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:52,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:52,386 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:52,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:52,387 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016292387 2023-02-10 07:54:52,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:54:52,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-10 07:54:52,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:52,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x7a7d4d90 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:54:52,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5591d37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:54:52,393 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:52,393 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:52,393 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:52,393 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:52,393 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:53,221 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283267f2d4e3934ec58d9f08b877941bec to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283267f2d4e3934ec58d9f08b877941bec 2023-02-10 07:54:53,222 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:53,234 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:54:53,235 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43312, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:54:53,241 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:54:53,243 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59610, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:54:53,251 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3df07e77b074e3dae43b1f7258244cf first=Optional[r05] last=Optional[r8] 2023-02-10 07:54:53,251 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=51 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3df07e77b074e3dae43b1f7258244cf}] 2023-02-10 07:54:53,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3df07e77b074e3dae43b1f7258244cf for inclusion in d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:53,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-10 07:54:53,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:54:53,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for d67328b9944e1b0543f40d85608b9019: 2023-02-10 07:54:53,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d3df07e77b074e3dae43b1f7258244cf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__67b79cl8liujq5dt5s2k8khcq3pv5ksnmb091m96o1j8ifdh1j0gs9ulagk74on2/family1/d3df07e77b074e3dae43b1f7258244cf 2023-02-10 07:54:53,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__67b79cl8liujq5dt5s2k8khcq3pv5ksnmb091m96o1j8ifdh1j0gs9ulagk74on2/family1/d3df07e77b074e3dae43b1f7258244cf as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/327dd194265a48428ee0c4c4b3f9bb2b_SeqId_53_ 2023-02-10 07:54:53,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__67b79cl8liujq5dt5s2k8khcq3pv5ksnmb091m96o1j8ifdh1j0gs9ulagk74on2/family1/d3df07e77b074e3dae43b1f7258244cf into d67328b9944e1b0543f40d85608b9019/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/327dd194265a48428ee0c4c4b3f9bb2b_SeqId_53_ - updating store file list. 2023-02-10 07:54:53,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/327dd194265a48428ee0c4c4b3f9bb2b_SeqId_53_ into d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:53,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__67b79cl8liujq5dt5s2k8khcq3pv5ksnmb091m96o1j8ifdh1j0gs9ulagk74on2/family1/d3df07e77b074e3dae43b1f7258244cf into d67328b9944e1b0543f40d85608b9019/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/327dd194265a48428ee0c4c4b3f9bb2b_SeqId_53_) 2023-02-10 07:54:53,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__67b79cl8liujq5dt5s2k8khcq3pv5ksnmb091m96o1j8ifdh1j0gs9ulagk74on2/family1/d3df07e77b074e3dae43b1f7258244cf 2023-02-10 07:54:53,268 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:53,269 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:54:53,270 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120605b80049d894942bce3c8e62a861f76 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120605b80049d894942bce3c8e62a861f76 2023-02-10 07:54:53,271 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282d20e433787543c6b6526d76073af5cf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282d20e433787543c6b6526d76073af5cf 2023-02-10 07:54:53,271 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-10 07:54:53,271 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-10 07:54:53,271 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:53,271 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:53,271 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:53,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:53,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:53,272 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:53,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 887 msec 2023-02-10 07:54:53,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-10 07:54:53,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:53,739 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-10 07:54:53,741 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-10 07:54:53,741 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-10 07:54:53,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-10 07:54:53,746 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, REOPEN/MOVE}] 2023-02-10 07:54:53,746 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, REOPEN/MOVE 2023-02-10 07:54:53,747 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:53,747 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015693747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015693747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015693747"}]},"ts":"1676015693747"} 2023-02-10 07:54:53,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:53,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:53,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d67328b9944e1b0543f40d85608b9019, disabling compactions & flushes 2023-02-10 07:54:53,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:53,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:53,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. after waiting 0 ms 2023-02-10 07:54:53,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:53,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-10 07:54:53,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:53,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d67328b9944e1b0543f40d85608b9019: Waiting for close lock at 1676015693900Running coprocessor pre-close hooks at 1676015693900Disabling compacts and flushes for region at 1676015693900Disabling writes for close at 1676015693900Writing region close event to WAL at 1676015693903 (+3 ms)Running coprocessor post-close hooks at 1676015693906 (+3 ms)Closed at 1676015693907 (+1 ms) 2023-02-10 07:54:53,907 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: d67328b9944e1b0543f40d85608b9019 to self. 2023-02-10 07:54:53,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:53,908 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=CLOSED 2023-02-10 07:54:53,909 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015693908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015693908"}]},"ts":"1676015693908"} 2023-02-10 07:54:53,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-10 07:54:53,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909 in 161 msec 2023-02-10 07:54:53,911 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=true 2023-02-10 07:54:54,062 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:54,062 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015694062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015694062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015694062"}]},"ts":"1676015694062"} 2023-02-10 07:54:54,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:54,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:54,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d67328b9944e1b0543f40d85608b9019, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:54:54,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:54,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:54,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:54,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:54,219 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:54,220 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:54,220 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1 2023-02-10 07:54:54,221 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d67328b9944e1b0543f40d85608b9019 columnFamilyName family1 2023-02-10 07:54:54,226 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/327dd194265a48428ee0c4c4b3f9bb2b_SeqId_53_ 2023-02-10 07:54:54,229 DEBUG [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/family1/545baa5e88b9430e900106ff003adbbb 2023-02-10 07:54:54,229 INFO [StoreOpener-d67328b9944e1b0543f40d85608b9019-1] regionserver.HStore(310): Store=d67328b9944e1b0543f40d85608b9019/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:54,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:54,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:54,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:54:54,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d67328b9944e1b0543f40d85608b9019; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72481850, jitterRate=0.08006373047828674}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:54:54,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d67328b9944e1b0543f40d85608b9019: Running coprocessor pre-open hook at 1676015694218Writing region info on filesystem at 1676015694218Initializing all the Stores at 1676015694219 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676015694219Cleaning up temporary data from old regions at 1676015694231 (+12 ms)Cleaning up detritus from prior splits at 1676015694231Running coprocessor post-open hooks at 1676015694234 (+3 ms)Region opened successfully at 1676015694234 2023-02-10 07:54:54,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019., pid=53, masterSystemTime=1676015694215 2023-02-10 07:54:54,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:54,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:54:54,236 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d67328b9944e1b0543f40d85608b9019, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:54,236 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676015694236"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015694236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015694236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015694236"}]},"ts":"1676015694236"} 2023-02-10 07:54:54,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-10 07:54:54,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure d67328b9944e1b0543f40d85608b9019, server=jenkins-hbase4.apache.org,36907,1676015618909 in 174 msec 2023-02-10 07:54:54,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-10 07:54:54,240 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d67328b9944e1b0543f40d85608b9019, REOPEN/MOVE in 492 msec 2023-02-10 07:54:54,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-10 07:54:54,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 497 msec 2023-02-10 07:54:54,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 913 msec 2023-02-10 07:54:54,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-10 07:54:54,245 INFO [Listener at localhost/46793] compactions.TestMobCompactor(278): alter status finished 2023-02-10 07:54:54,245 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-10 07:54:54,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:54,247 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:54,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:54,248 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016294248 2023-02-10 07:54:54,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:54:54,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-10 07:54:54,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:54,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x7f211ab8 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:54:54,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@325c00ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:54:54,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:54,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:54,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:54,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:54,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:54,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:54,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:54,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-10 07:54:54,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-10 07:54:54,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:54:54,255 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-10 07:54:54,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-02-10 07:54:54,316 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=242 (was 258), OpenFileDescriptor=616 (was 623), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 246), ProcessCount=168 (was 170), AvailableMemoryMB=3345 (was 3399) 2023-02-10 07:54:54,326 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=242, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=168, AvailableMemoryMB=3345 2023-02-10 07:54:54,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-10 07:54:54,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:54,330 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:54:54,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-10 07:54:54,330 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:54:54,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-10 07:54:54,331 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:54,332 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f empty. 2023-02-10 07:54:54,332 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:54,332 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-10 07:54:54,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-10 07:54:54,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-10 07:54:54,741 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-10 07:54:54,742 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2328dcff11ae9bcbfb736229cbac120f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:54:54,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-10 07:54:55,147 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:55,148 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 2328dcff11ae9bcbfb736229cbac120f, disabling compactions & flushes 2023-02-10 07:54:55,148 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:55,148 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:55,148 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. after waiting 0 ms 2023-02-10 07:54:55,148 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:55,148 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:55,148 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 2328dcff11ae9bcbfb736229cbac120f: Waiting for close lock at 1676015695148Disabling compacts and flushes for region at 1676015695148Disabling writes for close at 1676015695148Writing region close event to WAL at 1676015695148Closed at 1676015695148 2023-02-10 07:54:55,150 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:54:55,151 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015695151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015695151"}]},"ts":"1676015695151"} 2023-02-10 07:54:55,152 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:54:55,152 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:54:55,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015695152"}]},"ts":"1676015695152"} 2023-02-10 07:54:55,153 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-10 07:54:55,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, ASSIGN}] 2023-02-10 07:54:55,158 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, ASSIGN 2023-02-10 07:54:55,159 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:54:55,310 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:55,310 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015695310"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015695310"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015695310"}]},"ts":"1676015695310"} 2023-02-10 07:54:55,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:54:55,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-10 07:54:55,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:55,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2328dcff11ae9bcbfb736229cbac120f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:54:55,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:55,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:54:55,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:55,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:55,468 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:55,469 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:54:55,469 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:54:55,469 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2328dcff11ae9bcbfb736229cbac120f columnFamilyName family1 2023-02-10 07:54:55,470 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(310): Store=2328dcff11ae9bcbfb736229cbac120f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:54:55,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:55,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:55,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:54:55,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:54:55,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2328dcff11ae9bcbfb736229cbac120f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65011673, jitterRate=-0.03125058114528656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:54:55,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2328dcff11ae9bcbfb736229cbac120f: Running coprocessor pre-open hook at 1676015695467Writing region info on filesystem at 1676015695467Initializing all the Stores at 1676015695467Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676015695467Cleaning up temporary data from old regions at 1676015695472 (+5 ms)Cleaning up detritus from prior splits at 1676015695472Running coprocessor post-open hooks at 1676015695477 (+5 ms)Region opened successfully at 1676015695477 2023-02-10 07:54:55,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f., pid=57, masterSystemTime=1676015695463 2023-02-10 07:54:55,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:55,479 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:55,479 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:55,479 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015695479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015695479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015695479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015695479"}]},"ts":"1676015695479"} 2023-02-10 07:54:55,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-10 07:54:55,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909 in 168 msec 2023-02-10 07:54:55,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-10 07:54:55,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, ASSIGN in 324 msec 2023-02-10 07:54:55,483 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:54:55,483 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015695483"}]},"ts":"1676015695483"} 2023-02-10 07:54:55,484 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-10 07:54:55,488 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:54:55,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1600 sec 2023-02-10 07:54:56,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-10 07:54:56,435 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-10 07:54:56,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:56,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:56,459 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:54:56,459 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:56,459 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:54:56,459 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:54:56,460 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:56,460 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:56,461 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:56,461 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:56,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:56,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:56,461 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:56,461 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:56,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:56,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:56,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:56,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:56,462 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:56,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:56,463 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:54:56,463 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:56,463 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:54:56,463 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:56,463 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:56,463 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:56,463 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:54:56,464 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-10 07:54:56,882 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130905bcd34eebf468d8af26d394433e986 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130905bcd34eebf468d8af26d394433e986 2023-02-10 07:54:57,286 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/0d1943a17836451f8aaa76144c1389e7 2023-02-10 07:54:57,291 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/0d1943a17836451f8aaa76144c1389e7 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0d1943a17836451f8aaa76144c1389e7 2023-02-10 07:54:57,296 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0d1943a17836451f8aaa76144c1389e7, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-10 07:54:57,297 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 834ms, sequenceid=5, compaction requested=false 2023-02-10 07:54:57,297 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:54:57,297 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:54:57,297 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:57,297 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:57,298 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:57,298 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,298 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:54:57,298 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:54:57,299 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:57,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:57,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:57,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:57,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:57,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:54:57,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e9c72d3[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:57,301 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:54:57,301 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,302 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,302 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:54:57,302 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:54:57,302 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:57,302 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,302 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:57,305 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,305 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:54:57,305 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:57,305 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:54:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:57,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:57,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:54:57,307 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:54:57,307 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:57,307 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:57,307 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,307 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:57,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:57,308 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:57,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:57,309 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,310 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:57,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,315 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,315 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:57,315 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:57,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:54:57,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:57,315 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:57,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:57,315 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:57,315 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,316 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,316 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,316 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,316 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:57,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:57,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:57,316 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,316 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:57,416 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:57,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:57,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:57,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:57,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,422 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:54:57,422 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:57,422 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:54:57,422 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:54:57,422 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,422 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,425 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,425 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:57,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:57,425 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:57,425 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,426 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:54:57,426 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:57,426 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:54:57,426 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:57,426 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:54:57,426 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:57,426 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:57,426 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:57,427 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:54:57,427 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-10 07:54:57,578 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:54:57,842 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128539f8691278d4f33b5063ad00b7ff24b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128539f8691278d4f33b5063ad00b7ff24b 2023-02-10 07:54:58,248 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/1a171c185a624155b83dcf44c3dbd5e3 2023-02-10 07:54:58,252 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/1a171c185a624155b83dcf44c3dbd5e3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1a171c185a624155b83dcf44c3dbd5e3 2023-02-10 07:54:58,256 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1a171c185a624155b83dcf44c3dbd5e3, entries=1, sequenceid=9, filesize=5.0 K 2023-02-10 07:54:58,256 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 829ms, sequenceid=9, compaction requested=false 2023-02-10 07:54:58,257 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:54:58,257 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:54:58,257 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:54:58,258 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,258 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:58,258 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,259 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:58,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:58,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:58,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:58,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:54:58,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46334e21[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:58,260 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:54:58,260 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,261 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,261 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:54:58,261 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:54:58,261 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:58,261 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,261 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:58,262 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,262 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:54:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:58,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:54:58,265 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:54:58,265 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:58,265 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:58,265 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,265 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:58,267 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,267 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,267 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:58,267 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:58,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:58,268 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,270 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:58,270 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-10 07:54:58,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:54:58,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:58,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:58,271 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:58,271 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:58,371 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:58,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:58,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:58,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:58,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,377 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:54:58,377 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:58,378 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:54:58,378 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:54:58,378 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,378 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,379 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:58,379 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:58,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:58,379 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:58,379 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:58,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:58,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,380 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,380 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:54:58,380 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:58,380 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:54:58,380 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:58,380 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:54:58,381 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:58,381 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:58,381 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:58,381 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:54:58,381 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:58,792 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017b948b1d02624952b0544ea10c236312 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512017b948b1d02624952b0544ea10c236312 2023-02-10 07:54:59,198 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/04c025eb537746e3b03cfe843728d062 2023-02-10 07:54:59,202 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/04c025eb537746e3b03cfe843728d062 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/04c025eb537746e3b03cfe843728d062 2023-02-10 07:54:59,206 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/04c025eb537746e3b03cfe843728d062, entries=1, sequenceid=13, filesize=5.0 K 2023-02-10 07:54:59,207 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 826ms, sequenceid=13, compaction requested=true 2023-02-10 07:54:59,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:54:59,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:59,207 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:54:59,207 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:54:59,207 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,207 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:54:59,207 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:54:59,209 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,209 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:59,209 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,209 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:54:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:59,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:54:59,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4299113a[Count = 0] remaining members to acquire global barrier 2023-02-10 07:54:59,211 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:54:59,211 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,213 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,213 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:54:59,213 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:54:59,213 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:54:59,213 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,213 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:54:59,214 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:54:59,214 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:59,214 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,215 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:54:59,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:54:59,217 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:54:59,217 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:54:59,217 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:54:59,217 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,217 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:54:59,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:54:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:54:59,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:54:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,219 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:54:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,220 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:54:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:59,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:54:59,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:54:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:59,222 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:54:59,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:54:59,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:54:59,223 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:54:59,323 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:54:59,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:54:59,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:54:59,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:54:59,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,328 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:54:59,328 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:59,328 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:54:59,328 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:54:59,329 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,329 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,331 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,331 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:54:59,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:54:59,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:54:59,331 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:54:59,331 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:54:59,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:54:59,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,332 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:54:59,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:54:59,333 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:54:59,333 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:54:59,333 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:54:59,333 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:54:59,333 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:54:59,333 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:54:59,333 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:54:59,333 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:54:59,745 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512059b9a9551152a40b1a1da9ab9bf3b010f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059b9a9551152a40b1a1da9ab9bf3b010f 2023-02-10 07:55:00,150 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/22b6d62bf5b94224b00f3e2fd771d71a 2023-02-10 07:55:00,154 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/22b6d62bf5b94224b00f3e2fd771d71a as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/22b6d62bf5b94224b00f3e2fd771d71a 2023-02-10 07:55:00,158 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/22b6d62bf5b94224b00f3e2fd771d71a, entries=1, sequenceid=17, filesize=5.0 K 2023-02-10 07:55:00,159 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 826ms, sequenceid=17, compaction requested=true 2023-02-10 07:55:00,159 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:00,159 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:00,159 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:55:00,159 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:55:00,159 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,159 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:55:00,159 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:55:00,160 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,160 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:00,161 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,161 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:00,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:00,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:55:00,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47119c4b[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:00,162 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:55:00,162 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,166 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,166 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:55:00,166 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:55:00,166 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,166 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:00,166 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:00,168 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:55:00,168 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,168 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:00,169 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:55:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:00,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:00,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:55:00,170 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:55:00,170 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:00,170 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:00,171 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,171 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:00,172 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,172 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,172 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:00,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:00,172 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,173 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:00,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:00,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:00,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:00,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:00,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-10 07:55:00,175 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,175 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:00,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:00,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,176 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:00,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,176 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:00,176 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:00,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:00,276 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:00,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:00,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:00,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:00,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,282 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:00,282 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:00,282 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:55:00,282 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:55:00,282 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,282 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,283 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,283 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:00,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:00,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:00,284 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:00,284 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:00,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:00,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,284 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,285 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:55:00,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:00,285 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:55:00,285 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:00,285 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:55:00,285 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:55:00,285 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:00,285 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:00,285 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:55:00,285 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:55:00,697 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228dd96db27b94040dc835ac28990343773 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228dd96db27b94040dc835ac28990343773 2023-02-10 07:55:01,102 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/29e6e042311249ee9ec9a3424e964259 2023-02-10 07:55:01,106 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/29e6e042311249ee9ec9a3424e964259 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/29e6e042311249ee9ec9a3424e964259 2023-02-10 07:55:01,110 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/29e6e042311249ee9ec9a3424e964259, entries=1, sequenceid=21, filesize=5.0 K 2023-02-10 07:55:01,111 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 826ms, sequenceid=21, compaction requested=true 2023-02-10 07:55:01,111 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:01,111 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:55:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:55:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:55:01,111 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:55:01,114 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,114 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:01,114 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,114 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:01,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:55:01,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7aa67490[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:01,115 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:55:01,115 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,116 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,117 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:55:01,117 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:55:01,117 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,117 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:01,117 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:01,118 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,118 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:55:01,118 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:01,118 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:55:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:01,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:55:01,120 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:55:01,120 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:01,120 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:01,120 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,120 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:01,121 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,121 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:01,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,122 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:01,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:01,122 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,123 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,126 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:01,126 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:01,126 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:01,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-10 07:55:01,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:01,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:01,127 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:01,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:01,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:01,126 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,127 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,127 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,127 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,127 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,127 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,127 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:01,127 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:01,227 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:01,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:01,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:01,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:01,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,233 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:01,233 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:01,233 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:55:01,233 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:55:01,233 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,233 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,234 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:01,234 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:01,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:01,235 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:01,235 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:01,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:01,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,235 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,236 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:55:01,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:01,236 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:55:01,236 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:01,236 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:55:01,236 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:55:01,236 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:01,236 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:01,236 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:55:01,236 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:55:01,647 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e4c07449e5fb46c294e2cc080d89d7f5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4c07449e5fb46c294e2cc080d89d7f5 2023-02-10 07:55:02,053 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/0a2b96d84ad34f3cb95e3956301043fc 2023-02-10 07:55:02,058 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/0a2b96d84ad34f3cb95e3956301043fc as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0a2b96d84ad34f3cb95e3956301043fc 2023-02-10 07:55:02,062 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0a2b96d84ad34f3cb95e3956301043fc, entries=1, sequenceid=25, filesize=5.0 K 2023-02-10 07:55:02,063 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 827ms, sequenceid=25, compaction requested=true 2023-02-10 07:55:02,063 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:02,063 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:02,063 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:55:02,063 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:55:02,063 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,063 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:55:02,063 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:55:02,064 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,064 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:02,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:02,065 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,065 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:02,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:02,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:02,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:02,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:55:02,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26386fa3[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:02,066 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:55:02,066 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,067 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,067 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:55:02,067 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:55:02,068 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:02,068 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,068 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:02,069 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,069 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:55:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:02,069 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:02,069 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:55:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:02,071 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:55:02,071 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:55:02,071 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:02,071 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:02,071 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,071 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:02,074 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,074 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:02,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,074 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:02,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:02,075 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:02,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:02,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:02,076 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,080 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,080 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:02,080 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:02,080 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:02,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:02,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:02,080 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,080 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:02,081 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-10 07:55:02,081 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:02,081 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:02,081 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,081 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:02,081 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,181 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:02,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:02,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:02,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:02,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,187 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:02,187 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:02,187 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:55:02,187 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:55:02,188 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,188 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,191 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:02,191 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:02,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:02,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,192 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,193 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:55:02,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,193 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:55:02,193 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:02,193 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:55:02,193 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:55:02,193 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:02,193 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:02,193 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:55:02,193 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:55:02,608 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a3534047931148c790ed8434364c550a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3534047931148c790ed8434364c550a 2023-02-10 07:55:02,614 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/26685ca719b44396aef73f32b41142c8 2023-02-10 07:55:02,619 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/26685ca719b44396aef73f32b41142c8 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/26685ca719b44396aef73f32b41142c8 2023-02-10 07:55:02,622 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/26685ca719b44396aef73f32b41142c8, entries=1, sequenceid=29, filesize=5.0 K 2023-02-10 07:55:02,623 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 430ms, sequenceid=29, compaction requested=true 2023-02-10 07:55:02,623 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:02,623 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:02,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:55:02,624 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:55:02,624 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,624 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:55:02,624 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:55:02,626 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,626 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:02,627 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,627 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:02,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:02,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:55:02,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c22ba9f[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:02,628 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:55:02,628 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,629 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,630 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:55:02,630 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:55:02,630 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:02,630 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,630 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:02,631 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:55:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:02,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:02,631 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:02,632 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:02,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:02,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:55:02,634 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:55:02,634 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:02,634 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:02,634 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,634 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:02,635 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,635 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:02,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,636 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:02,636 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:02,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:02,637 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:02,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:02,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:02,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,640 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:02,640 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:02,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-10 07:55:02,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:02,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:02,741 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:02,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:02,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:02,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:02,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,747 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:02,747 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:02,747 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:55:02,747 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:55:02,748 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,748 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,749 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:02,749 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:02,750 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,750 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:02,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,751 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,751 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:55:02,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:55:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:55:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:55:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:02,751 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:02,751 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:55:02,751 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:55:03,167 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103932a53a2229b43da90255ff734c1f493 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103932a53a2229b43da90255ff734c1f493 2023-02-10 07:55:03,572 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/d02001860e9f47cebabd6ee908d90c8b 2023-02-10 07:55:03,576 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/d02001860e9f47cebabd6ee908d90c8b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/d02001860e9f47cebabd6ee908d90c8b 2023-02-10 07:55:03,580 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/d02001860e9f47cebabd6ee908d90c8b, entries=1, sequenceid=33, filesize=5.0 K 2023-02-10 07:55:03,581 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 830ms, sequenceid=33, compaction requested=true 2023-02-10 07:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:03,581 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:03,581 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:55:03,581 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:55:03,581 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,581 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:55:03,581 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:55:03,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,582 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:03,583 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,583 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:03,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:55:03,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@671a8894[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:03,584 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:55:03,584 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,585 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:55:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:55:03,585 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:03,585 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,585 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:03,587 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:55:03,587 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,587 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:03,587 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:55:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:03,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:55:03,590 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:55:03,590 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:03,590 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:03,590 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,590 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:03,591 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,591 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:03,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,591 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:03,592 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,593 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:03,595 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:03,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:03,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:03,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:03,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:03,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,595 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,596 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,596 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:03,596 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:03,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:03,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:03,696 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:03,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:03,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:03,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:03,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,702 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:03,702 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:03,702 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:55:03,702 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:55:03,703 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,703 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,705 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:03,705 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:03,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:03,706 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:03,706 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:03,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,706 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:55:03,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:03,706 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:55:03,707 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:03,707 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:55:03,707 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:55:03,707 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:03,707 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:03,707 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:55:03,707 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:55:04,120 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090763bbd61eb4c54034bbc5b705a0e197cf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015090763bbd61eb4c54034bbc5b705a0e197cf 2023-02-10 07:55:04,525 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/ec20490938d54261be10835acb1d0b72 2023-02-10 07:55:04,530 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/ec20490938d54261be10835acb1d0b72 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/ec20490938d54261be10835acb1d0b72 2023-02-10 07:55:04,533 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/ec20490938d54261be10835acb1d0b72, entries=1, sequenceid=37, filesize=5.0 K 2023-02-10 07:55:04,534 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 827ms, sequenceid=37, compaction requested=true 2023-02-10 07:55:04,534 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:04,534 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:04,534 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:55:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:55:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:55:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:55:04,536 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,536 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:04,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:04,537 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,537 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:55:04,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ed16213[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:04,538 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:55:04,538 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,539 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,539 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:55:04,539 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:55:04,539 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:04,539 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,539 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:04,540 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,540 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:55:04,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:04,540 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:04,541 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:55:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:04,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:04,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:55:04,543 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:55:04,543 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:04,543 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:04,543 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,543 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:04,545 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,545 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:04,546 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:04,546 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:04,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,547 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:04,549 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:04,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:04,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,549 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:04,550 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:04,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:04,650 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:04,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:04,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:04,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:04,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,656 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:04,656 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:04,656 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-10 07:55:04,656 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-10 07:55:04,657 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,657 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,658 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,658 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:04,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:04,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:04,659 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:04,659 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:04,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:04,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,659 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,659 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-10 07:55:04,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:04,660 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-10 07:55:04,660 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:04,660 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-10 07:55:04,660 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:55:04,660 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:04,660 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:04,660 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. started... 2023-02-10 07:55:04,660 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2328dcff11ae9bcbfb736229cbac120f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:55:05,072 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f67784419c274075bfdf060b694bcba2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f67784419c274075bfdf060b694bcba2 2023-02-10 07:55:05,477 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/19ad835bf04948b58fee58c9241010ca 2023-02-10 07:55:05,482 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/19ad835bf04948b58fee58c9241010ca as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/19ad835bf04948b58fee58c9241010ca 2023-02-10 07:55:05,485 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/19ad835bf04948b58fee58c9241010ca, entries=1, sequenceid=41, filesize=5.0 K 2023-02-10 07:55:05,486 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2328dcff11ae9bcbfb736229cbac120f in 826ms, sequenceid=41, compaction requested=true 2023-02-10 07:55:05,486 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:05,486 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:05,486 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:55:05,486 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:55:05,486 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,486 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-10 07:55:05,486 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-10 07:55:05,488 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,488 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:05,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:05,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:05,489 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,489 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:05,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:05,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:05,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-10 07:55:05,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b71551d[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:05,491 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-10 07:55:05,491 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,493 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,493 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-10 07:55:05,493 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-10 07:55:05,493 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:05,493 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,493 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-10 07:55:05,495 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,495 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-10 07:55:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:05,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:05,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:05,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-10 07:55:05,497 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-10 07:55:05,497 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:05,497 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:05,497 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,497 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:05,499 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,499 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:05,499 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:05,500 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,501 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,503 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,503 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:05,503 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,503 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:05,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:05,503 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:05,503 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-10 07:55:05,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:05,504 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:05,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:05,504 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,504 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,504 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,504 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:05,504 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:05,604 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:05,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:05,606 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:05,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:05,608 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:05,609 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:55:05,609 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016305609 2023-02-10 07:55:05,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:55:05,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-10 07:55:05,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:05,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x5190d72a to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:55:05,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@729fbe9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:55:05,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,456 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030f767a235c5f4b3294ff8557518e8f06 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601030f767a235c5f4b3294ff8557518e8f06 2023-02-10 07:55:06,457 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:06,470 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:55:06,471 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:55:06,477 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:55:06,477 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32996, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:55:06,486 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/af69a39ecdbd4076bff3f755b2aaf6ec first=Optional[r3] last=Optional[r6] 2023-02-10 07:55:06,486 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/af69a39ecdbd4076bff3f755b2aaf6ec}] 2023-02-10 07:55:06,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/af69a39ecdbd4076bff3f755b2aaf6ec for inclusion in 2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:06,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-10 07:55:06,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:55:06,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:06,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/af69a39ecdbd4076bff3f755b2aaf6ec to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__78o6vim2usoes7mso8cgi9pnt65sgkat8la645in9j10dt6sanhjhom8leo7ost9/family1/af69a39ecdbd4076bff3f755b2aaf6ec 2023-02-10 07:55:06,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__78o6vim2usoes7mso8cgi9pnt65sgkat8la645in9j10dt6sanhjhom8leo7ost9/family1/af69a39ecdbd4076bff3f755b2aaf6ec as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_ 2023-02-10 07:55:06,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__78o6vim2usoes7mso8cgi9pnt65sgkat8la645in9j10dt6sanhjhom8leo7ost9/family1/af69a39ecdbd4076bff3f755b2aaf6ec into 2328dcff11ae9bcbfb736229cbac120f/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_ - updating store file list. 2023-02-10 07:55:06,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_ into 2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:06,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__78o6vim2usoes7mso8cgi9pnt65sgkat8la645in9j10dt6sanhjhom8leo7ost9/family1/af69a39ecdbd4076bff3f755b2aaf6ec into 2328dcff11ae9bcbfb736229cbac120f/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_) 2023-02-10 07:55:06,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__78o6vim2usoes7mso8cgi9pnt65sgkat8la645in9j10dt6sanhjhom8leo7ost9/family1/af69a39ecdbd4076bff3f755b2aaf6ec 2023-02-10 07:55:06,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-10 07:55:06,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-10 07:55:06,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 2328dcff11ae9bcbfb736229cbac120f/family1 is initiating minor compaction 2023-02-10 07:55:06,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1fe4454c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:06,503 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2328dcff11ae9bcbfb736229cbac120f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:06,503 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1a171c185a624155b83dcf44c3dbd5e3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/04c025eb537746e3b03cfe843728d062, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/22b6d62bf5b94224b00f3e2fd771d71a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/29e6e042311249ee9ec9a3424e964259, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0a2b96d84ad34f3cb95e3956301043fc, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/26685ca719b44396aef73f32b41142c8, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/d02001860e9f47cebabd6ee908d90c8b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/ec20490938d54261be10835acb1d0b72, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/19ad835bf04948b58fee58c9241010ca, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp, totalSize=50.3 K 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 1a171c185a624155b83dcf44c3dbd5e3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 04c025eb537746e3b03cfe843728d062, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 22b6d62bf5b94224b00f3e2fd771d71a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 29e6e042311249ee9ec9a3424e964259, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0a2b96d84ad34f3cb95e3956301043fc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 26685ca719b44396aef73f32b41142c8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting d02001860e9f47cebabd6ee908d90c8b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting ec20490938d54261be10835acb1d0b72, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 19ad835bf04948b58fee58c9241010ca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-10 07:55:06,503 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-10 07:55:06,504 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:06,505 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:06,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228dd96db27b94040dc835ac28990343773 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228dd96db27b94040dc835ac28990343773 2023-02-10 07:55:06,508 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4c07449e5fb46c294e2cc080d89d7f5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231e4c07449e5fb46c294e2cc080d89d7f5 2023-02-10 07:55:06,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3534047931148c790ed8434364c550a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101a3534047931148c790ed8434364c550a 2023-02-10 07:55:06,510 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103932a53a2229b43da90255ff734c1f493 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103932a53a2229b43da90255ff734c1f493 2023-02-10 07:55:06,510 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-10 07:55:06,510 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-10 07:55:06,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:06,552 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2328dcff11ae9bcbfb736229cbac120f#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:06,983 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205622972223dd74eb98307463f67bf840a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205622972223dd74eb98307463f67bf840a 2023-02-10 07:55:06,983 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:07,006 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ae1407b5309b4a9882749d4b9a47f671 first=Optional[r00] last=Optional[r2] 2023-02-10 07:55:07,007 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ae1407b5309b4a9882749d4b9a47f671}] 2023-02-10 07:55:07,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ae1407b5309b4a9882749d4b9a47f671 for inclusion in 2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:07,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-10 07:55:07,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:55:07,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:07,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ae1407b5309b4a9882749d4b9a47f671 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pu0pqduqqe584mfapa3bjmnil4plojkva8s4k93g8homek0hsc384p62nu313vld/family1/ae1407b5309b4a9882749d4b9a47f671 2023-02-10 07:55:07,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pu0pqduqqe584mfapa3bjmnil4plojkva8s4k93g8homek0hsc384p62nu313vld/family1/ae1407b5309b4a9882749d4b9a47f671 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_ 2023-02-10 07:55:07,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pu0pqduqqe584mfapa3bjmnil4plojkva8s4k93g8homek0hsc384p62nu313vld/family1/ae1407b5309b4a9882749d4b9a47f671 into 2328dcff11ae9bcbfb736229cbac120f/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_ - updating store file list. 2023-02-10 07:55:07,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_ into 2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:07,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pu0pqduqqe584mfapa3bjmnil4plojkva8s4k93g8homek0hsc384p62nu313vld/family1/ae1407b5309b4a9882749d4b9a47f671 into 2328dcff11ae9bcbfb736229cbac120f/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_) 2023-02-10 07:55:07,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__pu0pqduqqe584mfapa3bjmnil4plojkva8s4k93g8homek0hsc384p62nu313vld/family1/ae1407b5309b4a9882749d4b9a47f671 2023-02-10 07:55:07,020 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:07,021 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:07,022 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130905bcd34eebf468d8af26d394433e986 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130905bcd34eebf468d8af26d394433e986 2023-02-10 07:55:07,023 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512017b948b1d02624952b0544ea10c236312 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512017b948b1d02624952b0544ea10c236312 2023-02-10 07:55:07,024 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059b9a9551152a40b1a1da9ab9bf3b010f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512059b9a9551152a40b1a1da9ab9bf3b010f 2023-02-10 07:55:07,024 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-10 07:55:07,024 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-10 07:55:07,024 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:07,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:07,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:55:07,025 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:07,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4180 sec 2023-02-10 07:55:07,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-10 07:55:07,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:07,385 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/0e5e685bec1b46699cab9d646afe9056 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0e5e685bec1b46699cab9d646afe9056 2023-02-10 07:55:07,390 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2328dcff11ae9bcbfb736229cbac120f/family1 of 2328dcff11ae9bcbfb736229cbac120f into 0e5e685bec1b46699cab9d646afe9056(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:55:07,390 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:07,390 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676015706502; duration=0sec 2023-02-10 07:55:07,390 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:07,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1a171c185a624155b83dcf44c3dbd5e3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/04c025eb537746e3b03cfe843728d062, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/22b6d62bf5b94224b00f3e2fd771d71a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/29e6e042311249ee9ec9a3424e964259, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0a2b96d84ad34f3cb95e3956301043fc, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/26685ca719b44396aef73f32b41142c8, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/d02001860e9f47cebabd6ee908d90c8b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/ec20490938d54261be10835acb1d0b72, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/19ad835bf04948b58fee58c9241010ca, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_] to archive 2023-02-10 07:55:07,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:07,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1a171c185a624155b83dcf44c3dbd5e3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1a171c185a624155b83dcf44c3dbd5e3 2023-02-10 07:55:07,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/04c025eb537746e3b03cfe843728d062 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/04c025eb537746e3b03cfe843728d062 2023-02-10 07:55:07,468 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/22b6d62bf5b94224b00f3e2fd771d71a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/22b6d62bf5b94224b00f3e2fd771d71a 2023-02-10 07:55:07,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/29e6e042311249ee9ec9a3424e964259 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/29e6e042311249ee9ec9a3424e964259 2023-02-10 07:55:07,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0a2b96d84ad34f3cb95e3956301043fc to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0a2b96d84ad34f3cb95e3956301043fc 2023-02-10 07:55:07,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/26685ca719b44396aef73f32b41142c8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/26685ca719b44396aef73f32b41142c8 2023-02-10 07:55:07,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/d02001860e9f47cebabd6ee908d90c8b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/d02001860e9f47cebabd6ee908d90c8b 2023-02-10 07:55:07,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/ec20490938d54261be10835acb1d0b72 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/ec20490938d54261be10835acb1d0b72 2023-02-10 07:55:07,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/19ad835bf04948b58fee58c9241010ca to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/19ad835bf04948b58fee58c9241010ca 2023-02-10 07:55:07,474 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/1cdfaa0d9fb04ff6bc9fff16f8d3d42d_SeqId_44_ 2023-02-10 07:55:07,513 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-10 07:55:07,514 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-10 07:55:07,514 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-10 07:55:07,515 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-10 07:55:07,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, REOPEN/MOVE}] 2023-02-10 07:55:07,518 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, REOPEN/MOVE 2023-02-10 07:55:07,519 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:07,519 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015707519"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015707519"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015707519"}]},"ts":"1676015707519"} 2023-02-10 07:55:07,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:07,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:07,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2328dcff11ae9bcbfb736229cbac120f, disabling compactions & flushes 2023-02-10 07:55:07,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:07,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:07,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. after waiting 0 ms 2023-02-10 07:55:07,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:07,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-10 07:55:07,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:07,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2328dcff11ae9bcbfb736229cbac120f: Waiting for close lock at 1676015707673Running coprocessor pre-close hooks at 1676015707673Disabling compacts and flushes for region at 1676015707673Disabling writes for close at 1676015707673Writing region close event to WAL at 1676015707676 (+3 ms)Running coprocessor post-close hooks at 1676015707680 (+4 ms)Closed at 1676015707680 2023-02-10 07:55:07,680 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 2328dcff11ae9bcbfb736229cbac120f to self. 2023-02-10 07:55:07,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:07,682 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=CLOSED 2023-02-10 07:55:07,682 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015707682"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015707682"}]},"ts":"1676015707682"} 2023-02-10 07:55:07,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-10 07:55:07,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909 in 162 msec 2023-02-10 07:55:07,685 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=true 2023-02-10 07:55:07,835 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:07,835 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015707835"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015707835"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015707835"}]},"ts":"1676015707835"} 2023-02-10 07:55:07,837 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:07,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:07,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2328dcff11ae9bcbfb736229cbac120f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:55:07,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:07,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:07,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:07,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:07,993 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:07,994 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:07,994 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:07,994 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2328dcff11ae9bcbfb736229cbac120f columnFamilyName family1 2023-02-10 07:55:07,999 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0d1943a17836451f8aaa76144c1389e7 2023-02-10 07:55:08,003 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0e5e685bec1b46699cab9d646afe9056 2023-02-10 07:55:08,006 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_ 2023-02-10 07:55:08,006 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(310): Store=2328dcff11ae9bcbfb736229cbac120f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:08,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:08,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:08,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:08,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2328dcff11ae9bcbfb736229cbac120f; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71375057, jitterRate=0.06357122957706451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:55:08,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2328dcff11ae9bcbfb736229cbac120f: Running coprocessor pre-open hook at 1676015707992Writing region info on filesystem at 1676015707992Initializing all the Stores at 1676015707993 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676015707993Cleaning up temporary data from old regions at 1676015708008 (+15 ms)Cleaning up detritus from prior splits at 1676015708009 (+1 ms)Running coprocessor post-open hooks at 1676015708011 (+2 ms)Region opened successfully at 1676015708011 2023-02-10 07:55:08,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f., pid=63, masterSystemTime=1676015707988 2023-02-10 07:55:08,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:08,012 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-10 07:55:08,013 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-10 07:55:08,014 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1912): 2328dcff11ae9bcbfb736229cbac120f/family1 is initiating minor compaction (all files) 2023-02-10 07:55:08,014 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2328dcff11ae9bcbfb736229cbac120f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:08,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:08,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:08,014 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0d1943a17836451f8aaa76144c1389e7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0e5e685bec1b46699cab9d646afe9056, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp, totalSize=388.1 K 2023-02-10 07:55:08,014 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:08,014 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0d1943a17836451f8aaa76144c1389e7, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842896 2023-02-10 07:55:08,014 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015708014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015708014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015708014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015708014"}]},"ts":"1676015708014"} 2023-02-10 07:55:08,015 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0e5e685bec1b46699cab9d646afe9056, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242896 2023-02-10 07:55:08,015 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 305335aefd99458b91dcfb8b5f0e385f_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878842896 2023-02-10 07:55:08,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-10 07:55:08,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909 in 179 msec 2023-02-10 07:55:08,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-10 07:55:08,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, REOPEN/MOVE in 499 msec 2023-02-10 07:55:08,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-10 07:55:08,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 504 msec 2023-02-10 07:55:08,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 918 msec 2023-02-10 07:55:08,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-10 07:55:08,024 INFO [Listener at localhost/46793] compactions.TestMobCompactor(278): alter status finished 2023-02-10 07:55:08,025 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:08,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:08,027 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:08,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:55:08,027 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016308027 2023-02-10 07:55:08,028 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:55:08,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-10 07:55:08,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:08,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x432cd4a4 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:55:08,029 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2328dcff11ae9bcbfb736229cbac120f#family1#compaction#74 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:08,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53489b35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:55:08,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:08,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:08,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:08,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:08,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:08,860 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112845389ffca3ad486dbce6190ab23792ea to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112845389ffca3ad486dbce6190ab23792ea 2023-02-10 07:55:08,861 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:08,873 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:55:08,874 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51996, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:55:08,880 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:55:08,881 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33010, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:55:08,889 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dfca4c384a6d42e68e1bb820a7e3b143 first=Optional[r05] last=Optional[r8] 2023-02-10 07:55:08,889 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=50 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dfca4c384a6d42e68e1bb820a7e3b143}] 2023-02-10 07:55:08,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dfca4c384a6d42e68e1bb820a7e3b143 for inclusion in 2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:08,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-10 07:55:08,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:55:08,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:08,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/dfca4c384a6d42e68e1bb820a7e3b143 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__a4uqliam9t6m30et8lijn6ifr9c2sonvrsg4393glfjrmu8nc60kkeob31ffnvc7/family1/dfca4c384a6d42e68e1bb820a7e3b143 2023-02-10 07:55:08,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__a4uqliam9t6m30et8lijn6ifr9c2sonvrsg4393glfjrmu8nc60kkeob31ffnvc7/family1/dfca4c384a6d42e68e1bb820a7e3b143 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/738d8f6169b6488c8a7c8a0914a6d53e_SeqId_52_ 2023-02-10 07:55:08,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__a4uqliam9t6m30et8lijn6ifr9c2sonvrsg4393glfjrmu8nc60kkeob31ffnvc7/family1/dfca4c384a6d42e68e1bb820a7e3b143 into 2328dcff11ae9bcbfb736229cbac120f/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/738d8f6169b6488c8a7c8a0914a6d53e_SeqId_52_ - updating store file list. 2023-02-10 07:55:08,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/738d8f6169b6488c8a7c8a0914a6d53e_SeqId_52_ into 2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:08,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__a4uqliam9t6m30et8lijn6ifr9c2sonvrsg4393glfjrmu8nc60kkeob31ffnvc7/family1/dfca4c384a6d42e68e1bb820a7e3b143 into 2328dcff11ae9bcbfb736229cbac120f/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/738d8f6169b6488c8a7c8a0914a6d53e_SeqId_52_) 2023-02-10 07:55:08,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__a4uqliam9t6m30et8lijn6ifr9c2sonvrsg4393glfjrmu8nc60kkeob31ffnvc7/family1/dfca4c384a6d42e68e1bb820a7e3b143 2023-02-10 07:55:08,903 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:08,904 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:08,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f67784419c274075bfdf060b694bcba2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120f67784419c274075bfdf060b694bcba2 2023-02-10 07:55:08,906 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128539f8691278d4f33b5063ad00b7ff24b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128539f8691278d4f33b5063ad00b7ff24b 2023-02-10 07:55:08,906 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-10 07:55:08,906 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-10 07:55:08,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:08,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:08,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:08,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:08,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:55:08,908 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:08,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 883 msec 2023-02-10 07:55:08,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$12(2441): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-10 07:55:08,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:09,249 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/.tmp/family1/e6008a7ae7f04d028340e0ee781003d6 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/e6008a7ae7f04d028340e0ee781003d6 2023-02-10 07:55:09,253 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2328dcff11ae9bcbfb736229cbac120f/family1 of 2328dcff11ae9bcbfb736229cbac120f into e6008a7ae7f04d028340e0ee781003d6(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:09,253 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2328dcff11ae9bcbfb736229cbac120f: 2023-02-10 07:55:09,253 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f., storeName=2328dcff11ae9bcbfb736229cbac120f/family1, priority=13, startTime=1676015708012; duration=1sec 2023-02-10 07:55:09,254 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:09,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0d1943a17836451f8aaa76144c1389e7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0e5e685bec1b46699cab9d646afe9056, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_] to archive 2023-02-10 07:55:09,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:09,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0d1943a17836451f8aaa76144c1389e7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0d1943a17836451f8aaa76144c1389e7 2023-02-10 07:55:09,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0e5e685bec1b46699cab9d646afe9056 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/0e5e685bec1b46699cab9d646afe9056 2023-02-10 07:55:09,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/305335aefd99458b91dcfb8b5f0e385f_SeqId_46_ 2023-02-10 07:55:09,369 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-10 07:55:09,370 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-10 07:55:09,370 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-10 07:55:09,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-10 07:55:09,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, REOPEN/MOVE}] 2023-02-10 07:55:09,374 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, REOPEN/MOVE 2023-02-10 07:55:09,374 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:09,374 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015709374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015709374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015709374"}]},"ts":"1676015709374"} 2023-02-10 07:55:09,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:09,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2328dcff11ae9bcbfb736229cbac120f, disabling compactions & flushes 2023-02-10 07:55:09,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:09,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:09,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. after waiting 0 ms 2023-02-10 07:55:09,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:09,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-02-10 07:55:09,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:09,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2328dcff11ae9bcbfb736229cbac120f: Waiting for close lock at 1676015709527Running coprocessor pre-close hooks at 1676015709527Disabling compacts and flushes for region at 1676015709527Disabling writes for close at 1676015709527Writing region close event to WAL at 1676015709531 (+4 ms)Running coprocessor post-close hooks at 1676015709534 (+3 ms)Closed at 1676015709534 2023-02-10 07:55:09,534 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 2328dcff11ae9bcbfb736229cbac120f to self. 2023-02-10 07:55:09,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,536 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=CLOSED 2023-02-10 07:55:09,536 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015709536"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015709536"}]},"ts":"1676015709536"} 2023-02-10 07:55:09,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-10 07:55:09,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909 in 162 msec 2023-02-10 07:55:09,539 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=true 2023-02-10 07:55:09,689 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:09,689 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015709689"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015709689"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015709689"}]},"ts":"1676015709689"} 2023-02-10 07:55:09,691 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:09,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:09,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2328dcff11ae9bcbfb736229cbac120f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:55:09,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:09,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,847 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,848 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:09,848 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1 2023-02-10 07:55:09,848 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2328dcff11ae9bcbfb736229cbac120f columnFamilyName family1 2023-02-10 07:55:09,853 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/738d8f6169b6488c8a7c8a0914a6d53e_SeqId_52_ 2023-02-10 07:55:09,856 DEBUG [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/family1/e6008a7ae7f04d028340e0ee781003d6 2023-02-10 07:55:09,856 INFO [StoreOpener-2328dcff11ae9bcbfb736229cbac120f-1] regionserver.HStore(310): Store=2328dcff11ae9bcbfb736229cbac120f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:09,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:55:09,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2328dcff11ae9bcbfb736229cbac120f; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63484089, jitterRate=-0.05401335656642914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:55:09,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2328dcff11ae9bcbfb736229cbac120f: Running coprocessor pre-open hook at 1676015709846Writing region info on filesystem at 1676015709846Initializing all the Stores at 1676015709846Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676015709847 (+1 ms)Cleaning up temporary data from old regions at 1676015709858 (+11 ms)Cleaning up detritus from prior splits at 1676015709859 (+1 ms)Running coprocessor post-open hooks at 1676015709862 (+3 ms)Region opened successfully at 1676015709862 2023-02-10 07:55:09,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f., pid=69, masterSystemTime=1676015709842 2023-02-10 07:55:09,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:09,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:55:09,864 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=2328dcff11ae9bcbfb736229cbac120f, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:09,864 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676015709864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015709864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015709864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015709864"}]},"ts":"1676015709864"} 2023-02-10 07:55:09,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-10 07:55:09,867 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 2328dcff11ae9bcbfb736229cbac120f, server=jenkins-hbase4.apache.org,36907,1676015618909 in 174 msec 2023-02-10 07:55:09,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-10 07:55:09,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=2328dcff11ae9bcbfb736229cbac120f, REOPEN/MOVE in 494 msec 2023-02-10 07:55:09,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-10 07:55:09,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 498 msec 2023-02-10 07:55:09,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 910 msec 2023-02-10 07:55:09,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-10 07:55:09,873 INFO [Listener at localhost/46793] compactions.TestMobCompactor(278): alter status finished 2023-02-10 07:55:09,874 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-10 07:55:09,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:09,876 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:09,876 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:55:09,876 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016309876 2023-02-10 07:55:09,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:55:09,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-10 07:55:09,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:09,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x62494ec6 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:55:09,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f66105b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:55:09,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:09,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:09,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:09,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:09,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:09,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:09,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:09,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-10 07:55:09,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-10 07:55:09,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:55:09,884 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-10 07:55:09,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-02-10 07:55:09,943 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249 (was 242) - Thread LEAK? -, OpenFileDescriptor=637 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=147 (was 189), ProcessCount=168 (was 168), AvailableMemoryMB=3342 (was 3345) 2023-02-10 07:55:09,954 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=249, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=168, AvailableMemoryMB=3341 2023-02-10 07:55:09,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-10 07:55:09,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-10 07:55:09,958 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:55:09,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-10 07:55:09,959 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:55:09,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-10 07:55:09,960 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:09,960 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3 empty. 2023-02-10 07:55:09,961 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:09,961 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-10 07:55:10,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-10 07:55:10,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-10 07:55:10,368 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-10 07:55:10,369 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 20c4f7c1f38c900a20a878a4bf53eec3, NAME => 'testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:55:10,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-10 07:55:10,775 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:10,776 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 20c4f7c1f38c900a20a878a4bf53eec3, disabling compactions & flushes 2023-02-10 07:55:10,776 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:10,776 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:10,776 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. after waiting 0 ms 2023-02-10 07:55:10,776 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:10,776 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:10,776 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 20c4f7c1f38c900a20a878a4bf53eec3: Waiting for close lock at 1676015710776Disabling compacts and flushes for region at 1676015710776Disabling writes for close at 1676015710776Writing region close event to WAL at 1676015710776Closed at 1676015710776 2023-02-10 07:55:10,778 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:55:10,778 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676015710778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015710778"}]},"ts":"1676015710778"} 2023-02-10 07:55:10,779 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:55:10,780 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:55:10,780 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015710780"}]},"ts":"1676015710780"} 2023-02-10 07:55:10,781 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-10 07:55:10,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=20c4f7c1f38c900a20a878a4bf53eec3, ASSIGN}] 2023-02-10 07:55:10,786 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=20c4f7c1f38c900a20a878a4bf53eec3, ASSIGN 2023-02-10 07:55:10,787 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=20c4f7c1f38c900a20a878a4bf53eec3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:55:10,938 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=20c4f7c1f38c900a20a878a4bf53eec3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:10,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676015710938"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015710938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015710938"}]},"ts":"1676015710938"} 2023-02-10 07:55:10,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 20c4f7c1f38c900a20a878a4bf53eec3, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:11,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-10 07:55:11,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:11,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 20c4f7c1f38c900a20a878a4bf53eec3, NAME => 'testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:55:11,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-10 07:55:11,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-10 07:55:11,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:11,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:11,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:11,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:11,096 INFO [StoreOpener-20c4f7c1f38c900a20a878a4bf53eec3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:11,097 DEBUG [StoreOpener-20c4f7c1f38c900a20a878a4bf53eec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1 2023-02-10 07:55:11,097 DEBUG [StoreOpener-20c4f7c1f38c900a20a878a4bf53eec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1 2023-02-10 07:55:11,098 INFO [StoreOpener-20c4f7c1f38c900a20a878a4bf53eec3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20c4f7c1f38c900a20a878a4bf53eec3 columnFamilyName f1 2023-02-10 07:55:11,099 INFO [StoreOpener-20c4f7c1f38c900a20a878a4bf53eec3-1] regionserver.HStore(310): Store=20c4f7c1f38c900a20a878a4bf53eec3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:11,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:11,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:11,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:11,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:55:11,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 20c4f7c1f38c900a20a878a4bf53eec3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75124963, jitterRate=0.119449183344841}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:55:11,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 20c4f7c1f38c900a20a878a4bf53eec3: Running coprocessor pre-open hook at 1676015711095Writing region info on filesystem at 1676015711095Initializing all the Stores at 1676015711096 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015711096Cleaning up temporary data from old regions at 1676015711100 (+4 ms)Cleaning up detritus from prior splits at 1676015711101 (+1 ms)Running coprocessor post-open hooks at 1676015711104 (+3 ms)Region opened successfully at 1676015711104 2023-02-10 07:55:11,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3., pid=73, masterSystemTime=1676015711090 2023-02-10 07:55:11,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:11,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:11,106 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=20c4f7c1f38c900a20a878a4bf53eec3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:11,107 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676015711106"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015711106"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015711106"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015711106"}]},"ts":"1676015711106"} 2023-02-10 07:55:11,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-10 07:55:11,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 20c4f7c1f38c900a20a878a4bf53eec3, server=jenkins-hbase4.apache.org,36907,1676015618909 in 169 msec 2023-02-10 07:55:11,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-10 07:55:11,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=20c4f7c1f38c900a20a878a4bf53eec3, ASSIGN in 324 msec 2023-02-10 07:55:11,111 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:55:11,111 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015711111"}]},"ts":"1676015711111"} 2023-02-10 07:55:11,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-10 07:55:11,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:55:11,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1570 sec 2023-02-10 07:55:12,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-10 07:55:12,064 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-10 07:55:12,064 DEBUG [Listener at localhost/46793] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-10 07:55:12,066 INFO [Listener at localhost/46793] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 07:55:12,069 INFO [Listener at localhost/46793] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-10 07:55:12,069 INFO [Listener at localhost/46793] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-10 07:55:12,069 INFO [Listener at localhost/46793] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-10 07:55:12,073 INFO [Listener at localhost/46793] regionserver.HRegion(2744): Flushing 20c4f7c1f38c900a20a878a4bf53eec3 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-10 07:55:12,484 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021026114a7c15ab4292befa41d22fcf9ec1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021026114a7c15ab4292befa41d22fcf9ec1 2023-02-10 07:55:12,889 INFO [Listener at localhost/46793] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/.tmp/f1/fac722dff7444ee2bc41088218d195ae 2023-02-10 07:55:12,894 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/.tmp/f1/fac722dff7444ee2bc41088218d195ae as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae 2023-02-10 07:55:12,897 INFO [Listener at localhost/46793] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae, entries=1, sequenceid=5, filesize=4.9 K 2023-02-10 07:55:12,898 INFO [Listener at localhost/46793] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 20c4f7c1f38c900a20a878a4bf53eec3 in 825ms, sequenceid=5, compaction requested=false 2023-02-10 07:55:12,898 DEBUG [Listener at localhost/46793] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-10 07:55:12,899 DEBUG [Listener at localhost/46793] regionserver.HRegion(2445): Flush status journal for 20c4f7c1f38c900a20a878a4bf53eec3: 2023-02-10 07:55:12,900 INFO [Listener at localhost/46793] regionserver.HRegion(2744): Flushing 20c4f7c1f38c900a20a878a4bf53eec3 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-10 07:55:13,210 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:55:13,257 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62494ec6 to 127.0.0.1:54857 2023-02-10 07:55:13,257 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:13,257 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:55:13,258 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x432cd4a4 to 127.0.0.1:54857 2023-02-10 07:55:13,258 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:13,258 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:55:13,258 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5190d72a to 127.0.0.1:54857 2023-02-10 07:55:13,258 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:13,261 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:55:13,261 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a7d4d90 to 127.0.0.1:54857 2023-02-10 07:55:13,261 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:13,263 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f211ab8 to 127.0.0.1:54857 2023-02-10 07:55:13,263 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:13,264 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:55:13,264 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x520b088d to 127.0.0.1:54857 2023-02-10 07:55:13,264 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:13,311 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021012a235ffef194e88b509b0ce985ac264 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021012a235ffef194e88b509b0ce985ac264 2023-02-10 07:55:13,716 INFO [Listener at localhost/46793] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/.tmp/f1/f20f61b0120d40c5967ee93b4b1712cf 2023-02-10 07:55:13,720 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/.tmp/f1/f20f61b0120d40c5967ee93b4b1712cf as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf 2023-02-10 07:55:13,723 INFO [Listener at localhost/46793] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf, entries=1, sequenceid=9, filesize=4.9 K 2023-02-10 07:55:13,724 INFO [Listener at localhost/46793] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 20c4f7c1f38c900a20a878a4bf53eec3 in 824ms, sequenceid=9, compaction requested=false 2023-02-10 07:55:13,724 DEBUG [Listener at localhost/46793] regionserver.HRegion(2445): Flush status journal for 20c4f7c1f38c900a20a878a4bf53eec3: 2023-02-10 07:55:13,725 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-10 07:55:13,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-10 07:55:13,727 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-10 07:55:13,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:55:13,727 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016313727 2023-02-10 07:55:13,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-10 07:55:13,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-10 07:55:13,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-10 07:55:13,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x352b8c75 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:55:13,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ac0b643, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:55:13,732 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230210 for table='testGetAfterCompaction' and column='f1' 2023-02-10 07:55:13,777 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,777 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,827 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,827 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,878 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,878 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,929 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,929 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,979 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:13,979 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,030 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,030 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,081 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,081 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,132 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,132 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,182 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,182 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,233 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,233 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,284 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,284 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,334 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,334 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,385 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,385 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,436 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,436 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,486 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,487 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,537 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,537 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,554 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021049ca5b1d162f489a8adb9bdb1049b5aa to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021049ca5b1d162f489a8adb9bdb1049b5aa 2023-02-10 07:55:14,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='testGetAfterCompaction' column='f1' 2023-02-10 07:55:14,572 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:55:14,573 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:55:14,579 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:55:14,581 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35894, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:55:14,588 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,588 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,588 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230210/f1/17f78209d51a44818967b6f178c6e170 first=Optional[r1] last=Optional[r2] 2023-02-10 07:55:14,589 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{f1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230210/f1/17f78209d51a44818967b6f178c6e170}] 2023-02-10 07:55:14,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230210/f1/17f78209d51a44818967b6f178c6e170 for inclusion in 20c4f7c1f38c900a20a878a4bf53eec3/f1 2023-02-10 07:55:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-10 07:55:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:55:14,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 20c4f7c1f38c900a20a878a4bf53eec3: 2023-02-10 07:55:14,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230210/f1/17f78209d51a44818967b6f178c6e170 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testGetAfterCompaction__5552g8k5bdcbgs7kmljc8kvstrstvtjmbd0uo6rg1tqfuhrd8u2l3edm81p3nl8f/f1/17f78209d51a44818967b6f178c6e170 2023-02-10 07:55:14,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testGetAfterCompaction__5552g8k5bdcbgs7kmljc8kvstrstvtjmbd0uo6rg1tqfuhrd8u2l3edm81p3nl8f/f1/17f78209d51a44818967b6f178c6e170 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_ 2023-02-10 07:55:14,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testGetAfterCompaction__5552g8k5bdcbgs7kmljc8kvstrstvtjmbd0uo6rg1tqfuhrd8u2l3edm81p3nl8f/f1/17f78209d51a44818967b6f178c6e170 into 20c4f7c1f38c900a20a878a4bf53eec3/f1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_ - updating store file list. 2023-02-10 07:55:14,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_ into 20c4f7c1f38c900a20a878a4bf53eec3/f1 2023-02-10 07:55:14,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testGetAfterCompaction__5552g8k5bdcbgs7kmljc8kvstrstvtjmbd0uo6rg1tqfuhrd8u2l3edm81p3nl8f/f1/17f78209d51a44818967b6f178c6e170 into 20c4f7c1f38c900a20a878a4bf53eec3/f1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_) 2023-02-10 07:55:14,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testGetAfterCompaction__5552g8k5bdcbgs7kmljc8kvstrstvtjmbd0uo6rg1tqfuhrd8u2l3edm81p3nl8f/f1/17f78209d51a44818967b6f178c6e170 2023-02-10 07:55:14,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 20c4f7c1f38c900a20a878a4bf53eec3/f1 is initiating minor compaction 2023-02-10 07:55:14,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2e6d712b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:14,604 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 20c4f7c1f38c900a20a878a4bf53eec3/f1 in testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:14,604 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/.tmp, totalSize=10.0 K 2023-02-10 07:55:14,604 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting f20f61b0120d40c5967ee93b4b1712cf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-10 07:55:14,604 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 39728bd4837b487daf581a0fa41853e4_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-10 07:55:14,606 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='testGetAfterCompaction' column='f1' 2023-02-10 07:55:14,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:14,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021012a235ffef194e88b509b0ce985ac264 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021012a235ffef194e88b509b0ce985ac264 2023-02-10 07:55:14,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021026114a7c15ab4292befa41d22fcf9ec1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021026114a7c15ab4292befa41d22fcf9ec1 2023-02-10 07:55:14,610 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-10 07:55:14,610 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230210' 2023-02-10 07:55:14,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230210 for table='testGetAfterCompaction' and column='f1' 2023-02-10 07:55:14,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-10 07:55:14,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:55:14,611 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-10 07:55:14,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 885 msec 2023-02-10 07:55:14,616 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 20c4f7c1f38c900a20a878a4bf53eec3#f1#compaction#77 average throughput is 0.04 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:14,639 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:14,639 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,639 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,642 DEBUG [Listener at localhost/46793] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-10 07:55:14,646 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-10 07:55:14,646 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:14,646 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-10 07:55:14,646 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-10 07:55:14,646 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-10 07:55:14,646 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. because compaction request was cancelled 2023-02-10 07:55:14,698 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:14,698 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,698 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,749 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:14,749 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,749 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,800 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:14,800 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,800 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,851 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:14,851 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,851 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,902 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:14,902 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,902 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,953 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:14,953 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:14,953 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,003 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,003 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,004 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,054 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,054 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,054 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,105 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,105 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,105 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,156 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,156 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,156 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,207 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,207 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,207 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,258 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,258 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,258 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,308 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,309 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,309 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,359 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,359 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,359 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,410 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,410 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,410 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,430 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/.tmp/f1/c742f85dad664fdb808083719a893d25 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/c742f85dad664fdb808083719a893d25 2023-02-10 07:55:15,435 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 20c4f7c1f38c900a20a878a4bf53eec3/f1 of 20c4f7c1f38c900a20a878a4bf53eec3 into c742f85dad664fdb808083719a893d25(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:55:15,435 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 20c4f7c1f38c900a20a878a4bf53eec3: 2023-02-10 07:55:15,435 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676015714603; duration=0sec 2023-02-10 07:55:15,435 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:15,461 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676015714551; access_time=1676015713743; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-10 07:55:15,461 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/c742f85dad664fdb808083719a893d25; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676015715426; access_time=1676015714609; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,461 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015713715; access_time=1676015712902; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,461 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_] to archive 2023-02-10 07:55:15,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:15,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/f20f61b0120d40c5967ee93b4b1712cf 2023-02-10 07:55:15,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/39728bd4837b487daf581a0fa41853e4_SeqId_12_ 2023-02-10 07:55:15,512 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/c742f85dad664fdb808083719a893d25; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676015715426; access_time=1676015714609; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,512 INFO [Listener at localhost/46793] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676015712889; access_time=1676015712075; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-10 07:55:15,628 INFO [Listener at localhost/46793] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-10 07:55:15,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-02-10 07:55:15,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-10 07:55:15,640 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015715640"}]},"ts":"1676015715640"} 2023-02-10 07:55:15,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-10 07:55:15,641 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-10 07:55:15,645 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-10 07:55:15,647 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=20c4f7c1f38c900a20a878a4bf53eec3, UNASSIGN}] 2023-02-10 07:55:15,648 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=20c4f7c1f38c900a20a878a4bf53eec3, UNASSIGN 2023-02-10 07:55:15,648 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=20c4f7c1f38c900a20a878a4bf53eec3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:15,648 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676015715648"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015715648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015715648"}]},"ts":"1676015715648"} 2023-02-10 07:55:15,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 20c4f7c1f38c900a20a878a4bf53eec3, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:15,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-10 07:55:15,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:15,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 20c4f7c1f38c900a20a878a4bf53eec3, disabling compactions & flushes 2023-02-10 07:55:15,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:15,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:15,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. after waiting 0 ms 2023-02-10 07:55:15,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:15,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-10 07:55:15,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-10 07:55:15,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3. 2023-02-10 07:55:15,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 20c4f7c1f38c900a20a878a4bf53eec3: Waiting for close lock at 1676015715801Running coprocessor pre-close hooks at 1676015715801Disabling compacts and flushes for region at 1676015715801Disabling writes for close at 1676015715801Writing region close event to WAL at 1676015715802 (+1 ms)Running coprocessor post-close hooks at 1676015715807 (+5 ms)Closed at 1676015715808 (+1 ms) 2023-02-10 07:55:15,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:15,810 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=20c4f7c1f38c900a20a878a4bf53eec3, regionState=CLOSED 2023-02-10 07:55:15,810 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676015715810"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015715810"}]},"ts":"1676015715810"} 2023-02-10 07:55:15,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-10 07:55:15,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 20c4f7c1f38c900a20a878a4bf53eec3, server=jenkins-hbase4.apache.org,36907,1676015618909 in 162 msec 2023-02-10 07:55:15,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-10 07:55:15,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=20c4f7c1f38c900a20a878a4bf53eec3, UNASSIGN in 165 msec 2023-02-10 07:55:15,814 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015715814"}]},"ts":"1676015715814"} 2023-02-10 07:55:15,815 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-10 07:55:15,817 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-10 07:55:15,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-02-10 07:55:15,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-10 07:55:15,943 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-10 07:55:15,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-02-10 07:55:15,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-10 07:55:15,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-10 07:55:15,956 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-10 07:55:15,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-10 07:55:15,958 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:15,960 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1, FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/recovered.edits] 2023-02-10 07:55:15,963 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/c742f85dad664fdb808083719a893d25 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/c742f85dad664fdb808083719a893d25 2023-02-10 07:55:15,964 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/f1/fac722dff7444ee2bc41088218d195ae 2023-02-10 07:55:15,966 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/recovered.edits/15.seqid to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3/recovered.edits/15.seqid 2023-02-10 07:55:15,966 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testGetAfterCompaction/20c4f7c1f38c900a20a878a4bf53eec3 2023-02-10 07:55:15,966 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-10 07:55:15,967 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-10 07:55:15,967 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-10 07:55:15,969 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021049ca5b1d162f489a8adb9bdb1049b5aa to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021049ca5b1d162f489a8adb9bdb1049b5aa 2023-02-10 07:55:15,970 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-10 07:55:15,971 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-10 07:55:15,992 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-10 07:55:15,994 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-10 07:55:15,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-10 07:55:15,995 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-10 07:55:15,995 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676015715995"}]},"ts":"9223372036854775807"} 2023-02-10 07:55:15,996 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-10 07:55:15,997 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 20c4f7c1f38c900a20a878a4bf53eec3, NAME => 'testGetAfterCompaction,,1676015709956.20c4f7c1f38c900a20a878a4bf53eec3.', STARTKEY => '', ENDKEY => ''}] 2023-02-10 07:55:15,997 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-10 07:55:15,997 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676015715997"}]},"ts":"9223372036854775807"} 2023-02-10 07:55:15,998 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-10 07:55:16,000 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-10 07:55:16,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 53 msec 2023-02-10 07:55:16,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-10 07:55:16,058 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-10 07:55:16,070 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=235 (was 249), OpenFileDescriptor=599 (was 637), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 147), ProcessCount=168 (was 168), AvailableMemoryMB=3300 (was 3341) 2023-02-10 07:55:16,080 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=235, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=168, AvailableMemoryMB=3300 2023-02-10 07:55:16,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-10 07:55:16,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-10 07:55:16,083 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:55:16,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-10 07:55:16,084 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:55:16,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-10 07:55:16,086 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:16,086 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:16,086 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:16,086 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d empty. 2023-02-10 07:55:16,086 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303 empty. 2023-02-10 07:55:16,086 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219 empty. 2023-02-10 07:55:16,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:16,087 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:16,087 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:16,087 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-10 07:55:16,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-10 07:55:16,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-10 07:55:16,494 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-10 07:55:16,495 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3193ddb2777ba7768b31c482473b0c2d, NAME => 'testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:55:16,496 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => ff8b684a362b59eaec4d1812a47bc303, NAME => 'testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:55:16,496 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 744b91c8a899e9abb35ea082e625e219, NAME => 'testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:55:16,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing ff8b684a362b59eaec4d1812a47bc303, disabling compactions & flushes 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 3193ddb2777ba7768b31c482473b0c2d, disabling compactions & flushes 2023-02-10 07:55:16,904 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:16,904 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. after waiting 0 ms 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. after waiting 0 ms 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:16,904 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 744b91c8a899e9abb35ea082e625e219, disabling compactions & flushes 2023-02-10 07:55:16,904 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:16,904 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 3193ddb2777ba7768b31c482473b0c2d: Waiting for close lock at 1676015716904Disabling compacts and flushes for region at 1676015716904Disabling writes for close at 1676015716904Writing region close event to WAL at 1676015716904Closed at 1676015716904 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. after waiting 0 ms 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:16,904 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for ff8b684a362b59eaec4d1812a47bc303: Waiting for close lock at 1676015716904Disabling compacts and flushes for region at 1676015716904Disabling writes for close at 1676015716904Writing region close event to WAL at 1676015716904Closed at 1676015716904 2023-02-10 07:55:16,905 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:16,905 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 744b91c8a899e9abb35ea082e625e219: Waiting for close lock at 1676015716904Disabling compacts and flushes for region at 1676015716904Disabling writes for close at 1676015716904Writing region close event to WAL at 1676015716905 (+1 ms)Closed at 1676015716905 2023-02-10 07:55:16,907 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:55:16,907 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015716907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015716907"}]},"ts":"1676015716907"} 2023-02-10 07:55:16,907 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015716907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015716907"}]},"ts":"1676015716907"} 2023-02-10 07:55:16,907 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015716907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015716907"}]},"ts":"1676015716907"} 2023-02-10 07:55:16,909 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-10 07:55:16,910 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:55:16,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015716910"}]},"ts":"1676015716910"} 2023-02-10 07:55:16,911 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-10 07:55:16,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, ASSIGN}] 2023-02-10 07:55:16,920 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, ASSIGN 2023-02-10 07:55:16,920 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, ASSIGN 2023-02-10 07:55:16,920 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, ASSIGN 2023-02-10 07:55:16,920 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:55:16,920 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:55:16,921 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:55:17,072 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=744b91c8a899e9abb35ea082e625e219, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:17,072 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=3193ddb2777ba7768b31c482473b0c2d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:17,072 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=ff8b684a362b59eaec4d1812a47bc303, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:17,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015717072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015717072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015717072"}]},"ts":"1676015717072"} 2023-02-10 07:55:17,072 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015717072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015717072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015717072"}]},"ts":"1676015717072"} 2023-02-10 07:55:17,072 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015717072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015717072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015717072"}]},"ts":"1676015717072"} 2023-02-10 07:55:17,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 744b91c8a899e9abb35ea082e625e219, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:17,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 3193ddb2777ba7768b31c482473b0c2d, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:17,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure ff8b684a362b59eaec4d1812a47bc303, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:17,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-10 07:55:17,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:17,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3193ddb2777ba7768b31c482473b0c2d, NAME => 'testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.', STARTKEY => '', ENDKEY => '1'} 2023-02-10 07:55:17,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:17,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:17,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:17,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:17,229 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:17,230 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1 2023-02-10 07:55:17,230 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1 2023-02-10 07:55:17,231 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3193ddb2777ba7768b31c482473b0c2d columnFamilyName family1 2023-02-10 07:55:17,232 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(310): Store=3193ddb2777ba7768b31c482473b0c2d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:17,232 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:17,233 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2 2023-02-10 07:55:17,233 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2 2023-02-10 07:55:17,234 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3193ddb2777ba7768b31c482473b0c2d columnFamilyName family2 2023-02-10 07:55:17,235 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(310): Store=3193ddb2777ba7768b31c482473b0c2d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:17,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:17,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:17,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:17,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:17,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:55:17,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3193ddb2777ba7768b31c482473b0c2d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71492448, jitterRate=0.06532049179077148}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:17,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3193ddb2777ba7768b31c482473b0c2d: Running coprocessor pre-open hook at 1676015717228Writing region info on filesystem at 1676015717228Initializing all the Stores at 1676015717229 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015717229Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015717229Cleaning up temporary data from old regions at 1676015717237 (+8 ms)Cleaning up detritus from prior splits at 1676015717237Running coprocessor post-open hooks at 1676015717242 (+5 ms)Region opened successfully at 1676015717242 2023-02-10 07:55:17,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d., pid=84, masterSystemTime=1676015717225 2023-02-10 07:55:17,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:17,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:17,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:17,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff8b684a362b59eaec4d1812a47bc303, NAME => 'testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.', STARTKEY => '2', ENDKEY => ''} 2023-02-10 07:55:17,244 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=3193ddb2777ba7768b31c482473b0c2d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:17,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:17,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015717244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015717244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015717244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015717244"}]},"ts":"1676015717244"} 2023-02-10 07:55:17,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:17,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:17,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:17,245 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:17,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-02-10 07:55:17,247 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1 2023-02-10 07:55:17,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 3193ddb2777ba7768b31c482473b0c2d, server=jenkins-hbase4.apache.org,36907,1676015618909 in 171 msec 2023-02-10 07:55:17,247 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1 2023-02-10 07:55:17,247 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff8b684a362b59eaec4d1812a47bc303 columnFamilyName family1 2023-02-10 07:55:17,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, ASSIGN in 330 msec 2023-02-10 07:55:17,248 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(310): Store=ff8b684a362b59eaec4d1812a47bc303/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:17,249 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:17,250 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2 2023-02-10 07:55:17,250 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2 2023-02-10 07:55:17,250 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff8b684a362b59eaec4d1812a47bc303 columnFamilyName family2 2023-02-10 07:55:17,251 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(310): Store=ff8b684a362b59eaec4d1812a47bc303/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:17,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:17,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:17,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:17,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:55:17,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ff8b684a362b59eaec4d1812a47bc303; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60889613, jitterRate=-0.09267406165599823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:17,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ff8b684a362b59eaec4d1812a47bc303: Running coprocessor pre-open hook at 1676015717245Writing region info on filesystem at 1676015717245Initializing all the Stores at 1676015717245Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015717245Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015717245Cleaning up temporary data from old regions at 1676015717253 (+8 ms)Cleaning up detritus from prior splits at 1676015717254 (+1 ms)Running coprocessor post-open hooks at 1676015717259 (+5 ms)Region opened successfully at 1676015717259 2023-02-10 07:55:17,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303., pid=85, masterSystemTime=1676015717225 2023-02-10 07:55:17,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:17,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:17,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:17,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 744b91c8a899e9abb35ea082e625e219, NAME => 'testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.', STARTKEY => '1', ENDKEY => '2'} 2023-02-10 07:55:17,261 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=ff8b684a362b59eaec4d1812a47bc303, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:17,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:17,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:17,261 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015717261"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015717261"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015717261"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015717261"}]},"ts":"1676015717261"} 2023-02-10 07:55:17,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:17,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:17,263 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:17,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-10 07:55:17,264 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure ff8b684a362b59eaec4d1812a47bc303, server=jenkins-hbase4.apache.org,36907,1676015618909 in 188 msec 2023-02-10 07:55:17,264 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1 2023-02-10 07:55:17,265 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1 2023-02-10 07:55:17,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, ASSIGN in 346 msec 2023-02-10 07:55:17,265 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 744b91c8a899e9abb35ea082e625e219 columnFamilyName family1 2023-02-10 07:55:17,266 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(310): Store=744b91c8a899e9abb35ea082e625e219/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:17,266 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:17,267 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2 2023-02-10 07:55:17,267 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2 2023-02-10 07:55:17,268 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 744b91c8a899e9abb35ea082e625e219 columnFamilyName family2 2023-02-10 07:55:17,268 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(310): Store=744b91c8a899e9abb35ea082e625e219/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:17,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:17,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:17,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:17,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:17,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:55:17,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 744b91c8a899e9abb35ea082e625e219; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61459573, jitterRate=-0.08418099582195282}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:17,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 744b91c8a899e9abb35ea082e625e219: Running coprocessor pre-open hook at 1676015717261Writing region info on filesystem at 1676015717261Initializing all the Stores at 1676015717262 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015717262Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015717263 (+1 ms)Cleaning up temporary data from old regions at 1676015717270 (+7 ms)Cleaning up detritus from prior splits at 1676015717271 (+1 ms)Running coprocessor post-open hooks at 1676015717275 (+4 ms)Region opened successfully at 1676015717275 2023-02-10 07:55:17,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219., pid=83, masterSystemTime=1676015717225 2023-02-10 07:55:17,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:17,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:17,277 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=744b91c8a899e9abb35ea082e625e219, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:17,277 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015717277"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015717277"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015717277"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015717277"}]},"ts":"1676015717277"} 2023-02-10 07:55:17,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-02-10 07:55:17,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 744b91c8a899e9abb35ea082e625e219, server=jenkins-hbase4.apache.org,36907,1676015618909 in 206 msec 2023-02-10 07:55:17,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-02-10 07:55:17,281 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, ASSIGN in 363 msec 2023-02-10 07:55:17,282 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:55:17,282 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015717282"}]},"ts":"1676015717282"} 2023-02-10 07:55:17,283 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-10 07:55:17,285 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:55:17,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2030 sec 2023-02-10 07:55:18,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-10 07:55:18,189 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-10 07:55:18,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:18,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:18,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:18,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:18,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-10 07:55:18,202 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-10 07:55:18,202 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:18,202 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-10 07:55:18,202 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-10 07:55:18,202 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:18,202 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:18,205 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:18,205 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:18,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:18,205 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:18,205 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:18,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:18,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:18,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:18,206 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-10 07:55:18,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-10 07:55:18,206 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-10 07:55:18,206 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:18,206 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-10 07:55:18,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:18,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. started... 2023-02-10 07:55:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:18,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:18,207 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3193ddb2777ba7768b31c482473b0c2d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:55:18,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. started... 2023-02-10 07:55:18,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:18,208 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. started... 2023-02-10 07:55:18,208 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 744b91c8a899e9abb35ea082e625e219 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:55:18,208 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ff8b684a362b59eaec4d1812a47bc303 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:55:18,620 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318 2023-02-10 07:55:18,620 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4 2023-02-10 07:55:18,621 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d 2023-02-10 07:55:18,626 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/a3ff78ff236442e9a2c297e9dc2e2fef 2023-02-10 07:55:19,026 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/32a1fdc2f81246ac907f976ad1ea613b 2023-02-10 07:55:19,026 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/5b6ae7c976314723827e4f82a3a27d3f 2023-02-10 07:55:19,038 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210a7093ca64eb1497cad0d1388139975d3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210a7093ca64eb1497cad0d1388139975d3 2023-02-10 07:55:19,440 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302102c94863126fa476699d03e2bd2a5c319 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302102c94863126fa476699d03e2bd2a5c319 2023-02-10 07:55:19,440 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302107a00e4b710b449bca145f265fd06dd31 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302107a00e4b710b449bca145f265fd06dd31 2023-02-10 07:55:19,442 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/6d30111acff54bf49981eca22dbdc6e5 2023-02-10 07:55:19,446 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/a3ff78ff236442e9a2c297e9dc2e2fef as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/a3ff78ff236442e9a2c297e9dc2e2fef 2023-02-10 07:55:19,447 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/13c047cdc7814849998094e93d74da3c 2023-02-10 07:55:19,449 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/a3ff78ff236442e9a2c297e9dc2e2fef, entries=4, sequenceid=5, filesize=5.4 K 2023-02-10 07:55:19,450 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/6d30111acff54bf49981eca22dbdc6e5 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/6d30111acff54bf49981eca22dbdc6e5 2023-02-10 07:55:19,451 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/5b6ae7c976314723827e4f82a3a27d3f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/5b6ae7c976314723827e4f82a3a27d3f 2023-02-10 07:55:19,454 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/6d30111acff54bf49981eca22dbdc6e5, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:55:19,455 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/5b6ae7c976314723827e4f82a3a27d3f, entries=4, sequenceid=5, filesize=5.4 K 2023-02-10 07:55:19,455 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ff8b684a362b59eaec4d1812a47bc303 in 1247ms, sequenceid=5, compaction requested=false 2023-02-10 07:55:19,455 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-10 07:55:19,455 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:19,455 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/13c047cdc7814849998094e93d74da3c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/13c047cdc7814849998094e93d74da3c 2023-02-10 07:55:19,455 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:19,455 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:19,458 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/13c047cdc7814849998094e93d74da3c, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:55:19,459 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 744b91c8a899e9abb35ea082e625e219 in 1251ms, sequenceid=5, compaction requested=false 2023-02-10 07:55:19,459 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:19,459 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:19,459 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:19,848 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/0b1791a83e884774b49d07239a14e0c9 2023-02-10 07:55:19,852 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/32a1fdc2f81246ac907f976ad1ea613b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/32a1fdc2f81246ac907f976ad1ea613b 2023-02-10 07:55:19,855 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/32a1fdc2f81246ac907f976ad1ea613b, entries=4, sequenceid=5, filesize=5.4 K 2023-02-10 07:55:19,856 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/0b1791a83e884774b49d07239a14e0c9 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/0b1791a83e884774b49d07239a14e0c9 2023-02-10 07:55:19,859 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/0b1791a83e884774b49d07239a14e0c9, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:55:19,860 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3193ddb2777ba7768b31c482473b0c2d in 1653ms, sequenceid=5, compaction requested=false 2023-02-10 07:55:19,860 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:19,860 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:19,860 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:19,860 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:19,860 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,860 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-10 07:55:19,860 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-10 07:55:19,862 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:19,862 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:19,862 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:19,862 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:19,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:19,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-10 07:55:19,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72bef8ae[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:19,863 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-10 07:55:19,863 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:19,864 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:19,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:19,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:19,865 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-10 07:55:19,865 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-10 07:55:19,865 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:19,865 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,865 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-10 07:55:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:19,866 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,866 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-10 07:55:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:19,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:19,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-10 07:55:19,868 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-10 07:55:19,868 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:19,868 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:19,868 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-10 07:55:19,868 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:19,870 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,870 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:19,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:19,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,870 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:19,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:19,871 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:19,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,872 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:19,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:19,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:19,874 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:19,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-10 07:55:19,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:19,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:19,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:19,874 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,875 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:19,875 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:19,975 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:19,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:19,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:19,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:19,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:19,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:19,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:19,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-10 07:55:19,981 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-10 07:55:19,982 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:19,982 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-10 07:55:19,982 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-10 07:55:19,982 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,982 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:19,983 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:19,983 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:19,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:19,983 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:19,984 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:19,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:19,984 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-10 07:55:19,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-10 07:55:19,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-10 07:55:19,985 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-10 07:55:19,985 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:19,985 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-10 07:55:19,985 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:19,985 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:19,985 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:19,985 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:19,985 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. started... 2023-02-10 07:55:19,985 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. started... 2023-02-10 07:55:19,985 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:19,985 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 744b91c8a899e9abb35ea082e625e219 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:55:19,985 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. started... 2023-02-10 07:55:19,985 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3193ddb2777ba7768b31c482473b0c2d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:55:19,985 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ff8b684a362b59eaec4d1812a47bc303 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:55:20,411 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201 2023-02-10 07:55:20,411 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d 2023-02-10 07:55:20,411 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8 2023-02-10 07:55:20,417 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/6f45a8d7ff3d4813b45d3f9446022ee1 2023-02-10 07:55:20,816 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/d338b24d69224058a6ff07d6021f4720 2023-02-10 07:55:20,817 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/7775dfe813fb4288a79d444dad06e8bf 2023-02-10 07:55:20,829 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302100b446da8140646c8a0dff1f2477f4a76 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100b446da8140646c8a0dff1f2477f4a76 2023-02-10 07:55:20,834 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/fc2e0af0eb924c2c9f2e7cba74673d9d 2023-02-10 07:55:20,838 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/6f45a8d7ff3d4813b45d3f9446022ee1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/6f45a8d7ff3d4813b45d3f9446022ee1 2023-02-10 07:55:20,841 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/6f45a8d7ff3d4813b45d3f9446022ee1, entries=4, sequenceid=9, filesize=5.4 K 2023-02-10 07:55:20,841 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/fc2e0af0eb924c2c9f2e7cba74673d9d as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/fc2e0af0eb924c2c9f2e7cba74673d9d 2023-02-10 07:55:20,845 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/fc2e0af0eb924c2c9f2e7cba74673d9d, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:55:20,845 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 744b91c8a899e9abb35ea082e625e219 in 860ms, sequenceid=9, compaction requested=false 2023-02-10 07:55:20,846 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:20,846 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:20,846 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:21,229 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210bee2141775e44b34adb06a3f01cb8ee0 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210bee2141775e44b34adb06a3f01cb8ee0 2023-02-10 07:55:21,230 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021096857228cc0c4720b5b6d6d012defe5e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021096857228cc0c4720b5b6d6d012defe5e 2023-02-10 07:55:21,309 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:55:21,635 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/2c25151abe2d45349cf59bd324a1d49f 2023-02-10 07:55:21,639 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/b3581b3afa09420ab9bfd09de18d3148 2023-02-10 07:55:21,639 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/7775dfe813fb4288a79d444dad06e8bf as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/7775dfe813fb4288a79d444dad06e8bf 2023-02-10 07:55:21,642 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/7775dfe813fb4288a79d444dad06e8bf, entries=4, sequenceid=9, filesize=5.4 K 2023-02-10 07:55:21,643 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/d338b24d69224058a6ff07d6021f4720 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d338b24d69224058a6ff07d6021f4720 2023-02-10 07:55:21,643 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/2c25151abe2d45349cf59bd324a1d49f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/2c25151abe2d45349cf59bd324a1d49f 2023-02-10 07:55:21,646 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d338b24d69224058a6ff07d6021f4720, entries=4, sequenceid=9, filesize=5.4 K 2023-02-10 07:55:21,647 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/2c25151abe2d45349cf59bd324a1d49f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:55:21,647 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/b3581b3afa09420ab9bfd09de18d3148 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b3581b3afa09420ab9bfd09de18d3148 2023-02-10 07:55:21,648 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3193ddb2777ba7768b31c482473b0c2d in 1663ms, sequenceid=9, compaction requested=false 2023-02-10 07:55:21,648 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:21,648 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:21,648 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:21,650 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b3581b3afa09420ab9bfd09de18d3148, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:55:21,651 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ff8b684a362b59eaec4d1812a47bc303 in 1666ms, sequenceid=9, compaction requested=false 2023-02-10 07:55:21,651 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:21,651 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:21,651 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:21,651 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:21,651 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,651 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-10 07:55:21,651 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-10 07:55:21,653 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,653 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:21,653 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:21,653 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:21,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:21,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-10 07:55:21,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41d39045[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:21,654 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-10 07:55:21,654 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:21,656 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:21,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:21,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:21,656 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-10 07:55:21,656 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-10 07:55:21,656 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:21,656 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,656 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-10 07:55:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:21,657 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-10 07:55:21,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:21,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:21,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:21,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:21,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:21,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:21,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:21,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:21,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-10 07:55:21,659 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-10 07:55:21,659 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:21,659 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:21,659 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-10 07:55:21,659 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:21,661 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,661 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:21,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,661 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:21,661 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:21,662 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:21,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:21,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,664 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:21,664 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:21,664 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:21,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-10 07:55:21,664 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:21,664 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:21,665 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:21,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:21,665 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-10 07:55:21,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:21,665 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:21,665 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:21,665 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:21,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:21,665 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:21,665 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:21,765 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:21,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:21,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:21,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:21,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:21,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:21,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:21,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-10 07:55:21,772 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-10 07:55:21,772 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:21,772 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-10 07:55:21,772 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-10 07:55:21,772 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,772 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:21,774 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,774 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:21,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:21,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:21,774 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:21,774 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:21,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:21,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:21,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-10 07:55:21,775 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-10 07:55:21,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-10 07:55:21,775 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-10 07:55:21,775 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-10 07:55:21,776 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:21,776 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. started... 2023-02-10 07:55:21,776 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:21,776 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3193ddb2777ba7768b31c482473b0c2d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:55:21,776 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:21,776 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:21,776 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. started... 2023-02-10 07:55:21,776 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. started... 2023-02-10 07:55:21,776 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 744b91c8a899e9abb35ea082e625e219 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:55:21,776 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ff8b684a362b59eaec4d1812a47bc303 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:55:22,193 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce 2023-02-10 07:55:22,193 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a 2023-02-10 07:55:22,193 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6 2023-02-10 07:55:22,604 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/5855fcb31ee84865a837469e36054852 2023-02-10 07:55:22,605 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/266bcb1710b047babae31ba9f5f50683 2023-02-10 07:55:22,605 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/1123e3c0319a47068c017070f557fcda 2023-02-10 07:55:22,627 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302102608f22ddd3247a5b078981aa136de18 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302102608f22ddd3247a5b078981aa136de18 2023-02-10 07:55:23,028 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210827ce867693b4bcb993f682692d25e11 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210827ce867693b4bcb993f682692d25e11 2023-02-10 07:55:23,028 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210ba0334cc870840278f9a3654df1654e2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210ba0334cc870840278f9a3654df1654e2 2023-02-10 07:55:23,033 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/420f88f654bb42cf828a7ba59c8d81f5 2023-02-10 07:55:23,037 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/1123e3c0319a47068c017070f557fcda as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1123e3c0319a47068c017070f557fcda 2023-02-10 07:55:23,040 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1123e3c0319a47068c017070f557fcda, entries=4, sequenceid=13, filesize=5.4 K 2023-02-10 07:55:23,041 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/420f88f654bb42cf828a7ba59c8d81f5 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/420f88f654bb42cf828a7ba59c8d81f5 2023-02-10 07:55:23,044 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/420f88f654bb42cf828a7ba59c8d81f5, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:55:23,045 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 744b91c8a899e9abb35ea082e625e219 in 1269ms, sequenceid=13, compaction requested=true 2023-02-10 07:55:23,045 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:23,045 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:23,045 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:23,435 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a 2023-02-10 07:55:23,435 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/c5e4e07154f24a7a95a1318704b50a59 2023-02-10 07:55:23,439 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/266bcb1710b047babae31ba9f5f50683 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/266bcb1710b047babae31ba9f5f50683 2023-02-10 07:55:23,440 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/5855fcb31ee84865a837469e36054852 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/5855fcb31ee84865a837469e36054852 2023-02-10 07:55:23,443 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/266bcb1710b047babae31ba9f5f50683, entries=4, sequenceid=13, filesize=5.4 K 2023-02-10 07:55:23,444 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/c5e4e07154f24a7a95a1318704b50a59 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/c5e4e07154f24a7a95a1318704b50a59 2023-02-10 07:55:23,444 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/5855fcb31ee84865a837469e36054852, entries=4, sequenceid=13, filesize=5.4 K 2023-02-10 07:55:23,445 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a 2023-02-10 07:55:23,448 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/c5e4e07154f24a7a95a1318704b50a59, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:55:23,448 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:55:23,449 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3193ddb2777ba7768b31c482473b0c2d in 1673ms, sequenceid=13, compaction requested=true 2023-02-10 07:55:23,449 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:23,449 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:23,449 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ff8b684a362b59eaec4d1812a47bc303 in 1673ms, sequenceid=13, compaction requested=true 2023-02-10 07:55:23,449 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:23,449 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-10 07:55:23,449 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-10 07:55:23,451 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:23,451 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:23,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:23,451 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:23,451 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:23,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:23,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:23,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:23,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:23,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-10 07:55:23,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64b7b396[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:23,453 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-10 07:55:23,453 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:23,454 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:23,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:23,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:23,454 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-10 07:55:23,454 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-10 07:55:23,455 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:23,455 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,455 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:23,463 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-10 07:55:23,463 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,463 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:23,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:23,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:23,463 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-10 07:55:23,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:23,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:23,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:23,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:23,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-10 07:55:23,466 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-10 07:55:23,466 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:23,466 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:23,466 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-10 07:55:23,466 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:23,467 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,467 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,467 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:23,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:23,468 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:23,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:23,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:23,469 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,471 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,471 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:23,471 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:23,471 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:23,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-10 07:55:23,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:23,471 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:23,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:23,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:23,471 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:23,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-10 07:55:23,471 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,471 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:23,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:23,472 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:23,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:23,471 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:23,472 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:23,472 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,572 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:23,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:23,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:23,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:23,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:23,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:23,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:23,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-10 07:55:23,578 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-10 07:55:23,578 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:23,578 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-10 07:55:23,578 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-10 07:55:23,578 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,578 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:23,580 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:23,580 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:23,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:23,581 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:23,581 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:23,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:23,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:23,581 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-10 07:55:23,582 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-10 07:55:23,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-10 07:55:23,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-10 07:55:23,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:23,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-10 07:55:23,582 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:23,582 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:23,582 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:23,582 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. started... 2023-02-10 07:55:23,582 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. started... 2023-02-10 07:55:23,582 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. started... 2023-02-10 07:55:23,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:23,582 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ff8b684a362b59eaec4d1812a47bc303 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:55:23,582 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:23,582 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3193ddb2777ba7768b31c482473b0c2d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:55:23,582 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 744b91c8a899e9abb35ea082e625e219 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:55:23,998 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02 2023-02-10 07:55:23,998 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1 2023-02-10 07:55:23,998 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4 2023-02-10 07:55:24,412 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/d10dd022c4db4600b9109970843796d1 2023-02-10 07:55:24,412 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/fc7cb9c260a54e7490f34395609725a4 2023-02-10 07:55:24,412 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/1c1d3adae8f247069c82056b964bd27b 2023-02-10 07:55:24,826 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021073345ed1a7cb4e139b419ce6c0f4945c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021073345ed1a7cb4e139b419ce6c0f4945c 2023-02-10 07:55:24,826 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210643ae3c5cc8a4ce69c2fb221d81608e4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210643ae3c5cc8a4ce69c2fb221d81608e4 2023-02-10 07:55:24,826 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302100d0a6c20a1b14655be63d83c86f4a7df to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100d0a6c20a1b14655be63d83c86f4a7df 2023-02-10 07:55:25,231 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/b312503929a24983b678fe125e4a21ca 2023-02-10 07:55:25,232 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/3fa8681ae5d94986b0b34484534aeab8 2023-02-10 07:55:25,232 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/b283ad650c844dfe8092e25b8a577ef4 2023-02-10 07:55:25,235 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/d10dd022c4db4600b9109970843796d1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d10dd022c4db4600b9109970843796d1 2023-02-10 07:55:25,236 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/fc7cb9c260a54e7490f34395609725a4 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/fc7cb9c260a54e7490f34395609725a4 2023-02-10 07:55:25,236 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/1c1d3adae8f247069c82056b964bd27b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1c1d3adae8f247069c82056b964bd27b 2023-02-10 07:55:25,239 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d10dd022c4db4600b9109970843796d1, entries=4, sequenceid=17, filesize=5.4 K 2023-02-10 07:55:25,239 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/fc7cb9c260a54e7490f34395609725a4, entries=4, sequenceid=17, filesize=5.4 K 2023-02-10 07:55:25,239 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/b312503929a24983b678fe125e4a21ca as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b312503929a24983b678fe125e4a21ca 2023-02-10 07:55:25,240 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/3fa8681ae5d94986b0b34484534aeab8 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/3fa8681ae5d94986b0b34484534aeab8 2023-02-10 07:55:25,244 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b312503929a24983b678fe125e4a21ca, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:55:25,244 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/3fa8681ae5d94986b0b34484534aeab8, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:55:25,245 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1c1d3adae8f247069c82056b964bd27b, entries=4, sequenceid=17, filesize=5.4 K 2023-02-10 07:55:25,245 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ff8b684a362b59eaec4d1812a47bc303 in 1663ms, sequenceid=17, compaction requested=true 2023-02-10 07:55:25,245 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3193ddb2777ba7768b31c482473b0c2d in 1663ms, sequenceid=17, compaction requested=true 2023-02-10 07:55:25,245 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:25,245 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:25,245 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:25,245 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:25,246 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:25,246 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:25,246 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/b283ad650c844dfe8092e25b8a577ef4 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/b283ad650c844dfe8092e25b8a577ef4 2023-02-10 07:55:25,249 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/b283ad650c844dfe8092e25b8a577ef4, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:55:25,250 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 744b91c8a899e9abb35ea082e625e219 in 1668ms, sequenceid=17, compaction requested=true 2023-02-10 07:55:25,250 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:25,250 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-10 07:55:25,250 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-10 07:55:25,252 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,252 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:25,252 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:25,252 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-10 07:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@252fdba0[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:25,253 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-10 07:55:25,253 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:25,254 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:25,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:25,255 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-10 07:55:25,255 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-10 07:55:25,255 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:25,255 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,255 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:25,256 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-10 07:55:25,256 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,256 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:25,256 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-10 07:55:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:25,258 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-10 07:55:25,258 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:25,259 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:25,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-10 07:55:25,259 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-10 07:55:25,259 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:25,261 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:25,261 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:25,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:25,261 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:25,262 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:25,263 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:25,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:25,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-10 07:55:25,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:25,265 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:25,265 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:25,266 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:25,266 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:25,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:25,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:25,366 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:25,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:25,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-10 07:55:25,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676015725376 (current time:1676015725376). 2023-02-10 07:55:25,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 07:55:25,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] zookeeper.ReadOnlyZKClient(139): Connect 0x5b191ca2 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:55:25,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74823856, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:55:25,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:55:25,390 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49006, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:55:25,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b191ca2 to 127.0.0.1:54857 2023-02-10 07:55:25,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:25,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 07:55:25,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-10 07:55:25,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-10 07:55:25,400 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-10 07:55:25,400 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676016325400 2023-02-10 07:55:25,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-10 07:55:25,401 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676015725367 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-10 07:55:25,402 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-10 07:55:25,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-10 07:55:25,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-10 07:55:25,403 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-10 07:55:25,404 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676016325404 2023-02-10 07:55:25,406 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:25,406 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 07:55:25,506 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:25,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:25,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:25,510 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 07:55:25,710 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:25,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:25,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:25,711 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-10 07:55:25,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676015725367 2023-02-10 07:55:25,812 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676015725367' 2023-02-10 07:55:25,812 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 07:55:25,812 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676015725367' starting 'acquire' 2023-02-10 07:55:25,812 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676015725367', kicking off acquire phase on members. 2023-02-10 07:55:25,812 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:25,812 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676015725367 2023-02-10 07:55:25,819 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,819 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 07:55:25,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 07:55:25,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 07:55:25,819 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,819 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:25,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676015725367 2023-02-10 07:55:25,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:25,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-10 07:55:25,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676015725367 2023-02-10 07:55:25,820 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676015725367 from table testCompactionWithHFileLink type FLUSH 2023-02-10 07:55:25,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676015725367 2023-02-10 07:55:25,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676015725367' with timeout 300000ms 2023-02-10 07:55:25,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-10 07:55:25,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676015725367' starting 'acquire' stage 2023-02-10 07:55:25,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676015725367' locally acquired 2023-02-10 07:55:25,822 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (snaptb-1676015725367) in zk 2023-02-10 07:55:25,824 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676015725367 2023-02-10 07:55:25,824 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 07:55:25,824 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676015725367 2023-02-10 07:55:25,824 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676015725367' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676015725367 2023-02-10 07:55:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:25,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'snaptb-1676015725367' on coordinator 2023-02-10 07:55:25,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20512c23[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:25,825 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676015725367' starting 'in-barrier' execution. 2023-02-10 07:55:25,825 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676015725367 2023-02-10 07:55:25,826 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676015725367 2023-02-10 07:55:25,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676015725367 2023-02-10 07:55:25,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676015725367 2023-02-10 07:55:25,826 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676015725367' received 'reached' from coordinator. 2023-02-10 07:55:25,826 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:25,826 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:25,827 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:25,827 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:25,827 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-10 07:55:25,827 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:25,827 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-10 07:55:25,827 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. started... 2023-02-10 07:55:25,827 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. started... 2023-02-10 07:55:25,827 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. started... 2023-02-10 07:55:25,828 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:25,828 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:25,828 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:25,828 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.' region-info for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,828 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.' region-info for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,828 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.' region-info for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,833 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 07:55:25,833 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 07:55:25,833 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-10 07:55:25,837 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/32a1fdc2f81246ac907f976ad1ea613b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/7775dfe813fb4288a79d444dad06e8bf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/266bcb1710b047babae31ba9f5f50683, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/fc7cb9c260a54e7490f34395609725a4] hfiles 2023-02-10 07:55:25,837 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/5b6ae7c976314723827e4f82a3a27d3f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/6f45a8d7ff3d4813b45d3f9446022ee1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1123e3c0319a47068c017070f557fcda, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1c1d3adae8f247069c82056b964bd27b] hfiles 2023-02-10 07:55:25,837 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/32a1fdc2f81246ac907f976ad1ea613b for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,837 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/a3ff78ff236442e9a2c297e9dc2e2fef, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d338b24d69224058a6ff07d6021f4720, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/5855fcb31ee84865a837469e36054852, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d10dd022c4db4600b9109970843796d1] hfiles 2023-02-10 07:55:25,837 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/5b6ae7c976314723827e4f82a3a27d3f for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,837 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/a3ff78ff236442e9a2c297e9dc2e2fef for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,984 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-10 07:55:25,985 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:55:25,985 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x352b8c75 to 127.0.0.1:54857 2023-02-10 07:55:25,985 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:25,986 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/7775dfe813fb4288a79d444dad06e8bf for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,986 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/6f45a8d7ff3d4813b45d3f9446022ee1 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,986 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d338b24d69224058a6ff07d6021f4720 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1123e3c0319a47068c017070f557fcda for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/266bcb1710b047babae31ba9f5f50683 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1c1d3adae8f247069c82056b964bd27b for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/fc7cb9c260a54e7490f34395609725a4 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/5855fcb31ee84865a837469e36054852 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d10dd022c4db4600b9109970843796d1 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/0b1791a83e884774b49d07239a14e0c9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/2c25151abe2d45349cf59bd324a1d49f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/c5e4e07154f24a7a95a1318704b50a59, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/3fa8681ae5d94986b0b34484534aeab8] hfiles 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/0b1791a83e884774b49d07239a14e0c9 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/13c047cdc7814849998094e93d74da3c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/fc2e0af0eb924c2c9f2e7cba74673d9d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/420f88f654bb42cf828a7ba59c8d81f5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/b283ad650c844dfe8092e25b8a577ef4] hfiles 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/6d30111acff54bf49981eca22dbdc6e5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b3581b3afa09420ab9bfd09de18d3148, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b312503929a24983b678fe125e4a21ca] hfiles 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/13c047cdc7814849998094e93d74da3c for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/2c25151abe2d45349cf59bd324a1d49f for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/fc2e0af0eb924c2c9f2e7cba74673d9d for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/6d30111acff54bf49981eca22dbdc6e5 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/420f88f654bb42cf828a7ba59c8d81f5 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/c5e4e07154f24a7a95a1318704b50a59 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/b283ad650c844dfe8092e25b8a577ef4 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/3fa8681ae5d94986b0b34484534aeab8 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b3581b3afa09420ab9bfd09de18d3148 for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a for snapshot=snaptb-1676015725367 2023-02-10 07:55:25,987 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b312503929a24983b678fe125e4a21ca for snapshot=snaptb-1676015725367 2023-02-10 07:55:26,011 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:26,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:26,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:26,012 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-10 07:55:26,394 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. completed. 2023-02-10 07:55:26,394 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. completed. 2023-02-10 07:55:26,394 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:26,394 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:26,395 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. completed. 2023-02-10 07:55:26,395 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-10 07:55:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-10 07:55:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-10 07:55:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-10 07:55:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676015725367' locally completed 2023-02-10 07:55:26,395 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676015725367' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:26,398 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676015725367' has notified controller of completion 2023-02-10 07:55:26,398 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,398 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:26,398 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676015725367' completed. 2023-02-10 07:55:26,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:26,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 07:55:26,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:26,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:26,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676015725367 2023-02-10 07:55:26,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:26,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676015725367 2023-02-10 07:55:26,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676015725367' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:26,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'snaptb-1676015725367', counting down latch. Waiting for 0 more 2023-02-10 07:55:26,401 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676015725367' execution completed 2023-02-10 07:55:26,401 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:26,401 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:26,401 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676015725367 2023-02-10 07:55:26,401 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676015725367including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-10 07:55:26,402 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:26,402 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:26,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-10 07:55:26,402 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 07:55:26,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:26,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 07:55:26,403 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 07:55:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676015725367 2023-02-10 07:55:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:26,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676015725367 2023-02-10 07:55:26,404 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:26,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676015725367 2023-02-10 07:55:26,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,406 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,406 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676015725367 2023-02-10 07:55:26,406 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-10 07:55:26,406 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676015725367 2023-02-10 07:55:26,406 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:26,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676015725367 2023-02-10 07:55:26,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-10 07:55:26,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-10 07:55:26,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-10 07:55:26,406 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-10 07:55:26,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1676015725367 because node does not exist (not an error) 2023-02-10 07:55:26,406 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676015725367/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:26,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676015725367 2023-02-10 07:55:26,406 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676015725367 2023-02-10 07:55:26,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-10 07:55:26,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-10 07:55:26,406 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676015725367 2023-02-10 07:55:26,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-10 07:55:26,407 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676015725367 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6] mob files 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8 2023-02-10 07:55:26,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100b446da8140646c8a0dff1f2477f4a76, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100d0a6c20a1b14655be63d83c86f4a7df, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302102608f22ddd3247a5b078981aa136de18, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302107a00e4b710b449bca145f265fd06dd31, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021073345ed1a7cb4e139b419ce6c0f4945c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210827ce867693b4bcb993f682692d25e11, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021096857228cc0c4720b5b6d6d012defe5e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210a7093ca64eb1497cad0d1388139975d3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302102c94863126fa476699d03e2bd2a5c319, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210643ae3c5cc8a4ce69c2fb221d81608e4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210ba0334cc870840278f9a3654df1654e2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210bee2141775e44b34adb06a3f01cb8ee0] mob files 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100b446da8140646c8a0dff1f2477f4a76 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100d0a6c20a1b14655be63d83c86f4a7df 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302102608f22ddd3247a5b078981aa136de18 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302107a00e4b710b449bca145f265fd06dd31 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021073345ed1a7cb4e139b419ce6c0f4945c 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210827ce867693b4bcb993f682692d25e11 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021096857228cc0c4720b5b6d6d012defe5e 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210a7093ca64eb1497cad0d1388139975d3 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302102c94863126fa476699d03e2bd2a5c319 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210643ae3c5cc8a4ce69c2fb221d81608e4 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210ba0334cc870840278f9a3654df1654e2 2023-02-10 07:55:26,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210bee2141775e44b34adb06a3f01cb8ee0 2023-02-10 07:55:26,512 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:26,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:26,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:26,513 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-10 07:55:26,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676015725367 2023-02-10 07:55:26,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp/snaptb-1676015725367 2023-02-10 07:55:27,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp/snaptb-1676015725367 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/snaptb-1676015725367 2023-02-10 07:55:27,513 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:27,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:27,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:27,514 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-10 07:55:27,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676015725367 of table testCompactionWithHFileLink completed 2023-02-10 07:55:27,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp/snaptb-1676015725367 2023-02-10 07:55:27,670 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp/snaptb-1676015725367 2023-02-10 07:55:27,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676015725367 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676015725401Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676015726814 (+1413 ms)Consolidate snapshot: snaptb-1676015725367 at 1676015726814Loading Region manifests for snaptb-1676015725367 at 1676015726814Writing data manifest for snaptb-1676015725367 at 1676015726823 (+9 ms)Verifying snapshot: snaptb-1676015725367 at 1676015727230 (+407 ms)Snapshot snaptb-1676015725367 of table testCompactionWithHFileLink completed at 1676015727670 (+440 ms) 2023-02-10 07:55:27,671 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-10 07:55:27,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.2690 sec 2023-02-10 07:55:29,514 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:29,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:29,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 07:55:29,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:29,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:29,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-10 07:55:29,550 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-10 07:55:29,550 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:29,550 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-10 07:55:29,550 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-10 07:55:29,550 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:29,550 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:29,552 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:29,552 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:29,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:29,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:29,552 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:29,552 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:29,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:29,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:29,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:29,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:29,553 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-10 07:55:29,553 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-10 07:55:29,553 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-10 07:55:29,553 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:29,553 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-10 07:55:29,553 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:29,553 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:29,553 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. started... 2023-02-10 07:55:29,553 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. started... 2023-02-10 07:55:29,553 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 744b91c8a899e9abb35ea082e625e219 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:55:29,554 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3193ddb2777ba7768b31c482473b0c2d 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:55:29,554 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:29,554 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:29,554 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:29,555 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. started... 2023-02-10 07:55:29,555 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ff8b684a362b59eaec4d1812a47bc303 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:55:30,369 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/b93a7497f91f4399870a4cfcffbb9e31 2023-02-10 07:55:30,373 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b93a7497f91f4399870a4cfcffbb9e31 2023-02-10 07:55:30,374 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/77678c9ca9854f42970baff543ca5345 2023-02-10 07:55:30,374 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/68d8048d9b6b4a0fb688bbee098ad39f 2023-02-10 07:55:30,377 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77678c9ca9854f42970baff543ca5345 2023-02-10 07:55:30,378 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68d8048d9b6b4a0fb688bbee098ad39f 2023-02-10 07:55:30,794 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/04504c3593da484b958e700dbb6d9eaf 2023-02-10 07:55:30,798 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04504c3593da484b958e700dbb6d9eaf 2023-02-10 07:55:30,799 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/b93a7497f91f4399870a4cfcffbb9e31 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/b93a7497f91f4399870a4cfcffbb9e31 2023-02-10 07:55:30,801 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/4a791d1979604940a93dd8988e439a88 2023-02-10 07:55:30,803 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b93a7497f91f4399870a4cfcffbb9e31 2023-02-10 07:55:30,803 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/b93a7497f91f4399870a4cfcffbb9e31, entries=3, sequenceid=24, filesize=5.0 K 2023-02-10 07:55:30,804 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/04504c3593da484b958e700dbb6d9eaf as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/04504c3593da484b958e700dbb6d9eaf 2023-02-10 07:55:30,804 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a791d1979604940a93dd8988e439a88 2023-02-10 07:55:30,805 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/68d8048d9b6b4a0fb688bbee098ad39f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/68d8048d9b6b4a0fb688bbee098ad39f 2023-02-10 07:55:30,808 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 04504c3593da484b958e700dbb6d9eaf 2023-02-10 07:55:30,808 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/04504c3593da484b958e700dbb6d9eaf, entries=1, sequenceid=24, filesize=5.0 K 2023-02-10 07:55:30,808 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 744b91c8a899e9abb35ea082e625e219 in 1255ms, sequenceid=24, compaction requested=true 2023-02-10 07:55:30,808 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:30,808 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:30,809 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:30,809 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68d8048d9b6b4a0fb688bbee098ad39f 2023-02-10 07:55:30,809 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/68d8048d9b6b4a0fb688bbee098ad39f, entries=3, sequenceid=24, filesize=5.0 K 2023-02-10 07:55:30,810 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/4a791d1979604940a93dd8988e439a88 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/4a791d1979604940a93dd8988e439a88 2023-02-10 07:55:30,813 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a791d1979604940a93dd8988e439a88 2023-02-10 07:55:30,813 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/4a791d1979604940a93dd8988e439a88, entries=1, sequenceid=24, filesize=5.0 K 2023-02-10 07:55:30,814 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3193ddb2777ba7768b31c482473b0c2d in 1261ms, sequenceid=24, compaction requested=true 2023-02-10 07:55:30,814 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:30,814 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:31,200 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/4e55935655e2495192354bfc8f7d9b30 2023-02-10 07:55:31,203 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e55935655e2495192354bfc8f7d9b30 2023-02-10 07:55:31,204 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/77678c9ca9854f42970baff543ca5345 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/77678c9ca9854f42970baff543ca5345 2023-02-10 07:55:31,207 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77678c9ca9854f42970baff543ca5345 2023-02-10 07:55:31,207 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/77678c9ca9854f42970baff543ca5345, entries=3, sequenceid=24, filesize=5.0 K 2023-02-10 07:55:31,208 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/4e55935655e2495192354bfc8f7d9b30 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/4e55935655e2495192354bfc8f7d9b30 2023-02-10 07:55:31,211 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e55935655e2495192354bfc8f7d9b30 2023-02-10 07:55:31,211 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/4e55935655e2495192354bfc8f7d9b30, entries=1, sequenceid=24, filesize=5.0 K 2023-02-10 07:55:31,212 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ff8b684a362b59eaec4d1812a47bc303 in 1657ms, sequenceid=24, compaction requested=true 2023-02-10 07:55:31,212 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:31,212 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:31,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:31,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:31,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,213 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-10 07:55:31,213 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-10 07:55:31,214 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:31,214 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:31,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:31,214 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:31,214 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:31,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:31,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:31,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:31,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:31,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-10 07:55:31,215 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-10 07:55:31,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d5dc1d4[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:31,216 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:31,221 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:31,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:31,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:31,221 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-10 07:55:31,221 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-10 07:55:31,221 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:31,221 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,221 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:31,222 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-10 07:55:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:31,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-10 07:55:31,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:31,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:31,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-10 07:55:31,224 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-10 07:55:31,225 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:31,225 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:31,225 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-10 07:55:31,225 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:31,226 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:31,226 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:31,226 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:31,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:31,226 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:31,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:31,227 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-10 07:55:31,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,230 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:31,230 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,230 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:31,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-10 07:55:31,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:31,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:31,230 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:31,230 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:31,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-10 07:55:31,231 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:31,231 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-10 07:55:31,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:31,231 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:31,231 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:31,231 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:31,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:31,231 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-10 07:55:31,231 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-10 07:55:31,331 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:31,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:31,333 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:31,333 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 3193ddb2777ba7768b31c482473b0c2d/family1 is initiating major compaction (all files) 2023-02-10 07:55:31,333 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:31,333 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:31,333 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 3193ddb2777ba7768b31c482473b0c2d/family1 in testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:31,333 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/32a1fdc2f81246ac907f976ad1ea613b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/7775dfe813fb4288a79d444dad06e8bf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/266bcb1710b047babae31ba9f5f50683, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/fc7cb9c260a54e7490f34395609725a4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/68d8048d9b6b4a0fb688bbee098ad39f] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp, totalSize=26.7 K 2023-02-10 07:55:31,334 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 32a1fdc2f81246ac907f976ad1ea613b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718195 2023-02-10 07:55:31,334 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 7775dfe813fb4288a79d444dad06e8bf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:31,335 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 266bcb1710b047babae31ba9f5f50683, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:31,335 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting fc7cb9c260a54e7490f34395609725a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723573 2023-02-10 07:55:31,335 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 68d8048d9b6b4a0fb688bbee098ad39f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-10 07:55:31,347 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 3193ddb2777ba7768b31c482473b0c2d#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:31,755 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021085672e86802648a885b16dd09da5088c_del 2023-02-10 07:55:31,755 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021085672e86802648a885b16dd09da5088c_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021085672e86802648a885b16dd09da5088c_del 2023-02-10 07:55:32,567 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 895abce1217940239fa1f29d682d98d9 2023-02-10 07:55:32,568 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/895abce1217940239fa1f29d682d98d9 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/895abce1217940239fa1f29d682d98d9 2023-02-10 07:55:32,571 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 895abce1217940239fa1f29d682d98d9 2023-02-10 07:55:32,572 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3193ddb2777ba7768b31c482473b0c2d/family1 of 3193ddb2777ba7768b31c482473b0c2d into 895abce1217940239fa1f29d682d98d9(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:32,572 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:32,572 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:32,572 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 3193ddb2777ba7768b31c482473b0c2d/family2 is initiating major compaction (all files) 2023-02-10 07:55:32,572 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:32,572 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:32,572 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 3193ddb2777ba7768b31c482473b0c2d/family2 in testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:32,573 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/0b1791a83e884774b49d07239a14e0c9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/2c25151abe2d45349cf59bd324a1d49f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/c5e4e07154f24a7a95a1318704b50a59, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/3fa8681ae5d94986b0b34484534aeab8, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/4a791d1979604940a93dd8988e439a88] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp, totalSize=25.4 K 2023-02-10 07:55:32,573 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 0b1791a83e884774b49d07239a14e0c9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718195 2023-02-10 07:55:32,573 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 2c25151abe2d45349cf59bd324a1d49f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:32,573 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting c5e4e07154f24a7a95a1318704b50a59, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:32,574 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 3fa8681ae5d94986b0b34484534aeab8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723573 2023-02-10 07:55:32,574 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 4a791d1979604940a93dd8988e439a88, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-10 07:55:32,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/32a1fdc2f81246ac907f976ad1ea613b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/7775dfe813fb4288a79d444dad06e8bf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/266bcb1710b047babae31ba9f5f50683, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/fc7cb9c260a54e7490f34395609725a4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/68d8048d9b6b4a0fb688bbee098ad39f] to archive 2023-02-10 07:55:32,583 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 3193ddb2777ba7768b31c482473b0c2d#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:32,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:32,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/32a1fdc2f81246ac907f976ad1ea613b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/32a1fdc2f81246ac907f976ad1ea613b 2023-02-10 07:55:32,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/7775dfe813fb4288a79d444dad06e8bf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/7775dfe813fb4288a79d444dad06e8bf 2023-02-10 07:55:32,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/266bcb1710b047babae31ba9f5f50683 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/266bcb1710b047babae31ba9f5f50683 2023-02-10 07:55:32,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/fc7cb9c260a54e7490f34395609725a4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/fc7cb9c260a54e7490f34395609725a4 2023-02-10 07:55:32,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/68d8048d9b6b4a0fb688bbee098ad39f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/68d8048d9b6b4a0fb688bbee098ad39f 2023-02-10 07:55:32,992 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021073a0caa9fbe34f36b439ec0575322587_del 2023-02-10 07:55:32,992 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021073a0caa9fbe34f36b439ec0575322587_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021073a0caa9fbe34f36b439ec0575322587_del 2023-02-10 07:55:33,804 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64d4e37061ee4eb98b888e09f02ed56f 2023-02-10 07:55:33,805 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/64d4e37061ee4eb98b888e09f02ed56f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/64d4e37061ee4eb98b888e09f02ed56f 2023-02-10 07:55:33,808 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64d4e37061ee4eb98b888e09f02ed56f 2023-02-10 07:55:33,809 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3193ddb2777ba7768b31c482473b0c2d/family2 of 3193ddb2777ba7768b31c482473b0c2d into 64d4e37061ee4eb98b888e09f02ed56f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:33,809 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:33,809 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:33,809 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 744b91c8a899e9abb35ea082e625e219/family1 is initiating major compaction (all files) 2023-02-10 07:55:33,809 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:33,809 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:33,810 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 744b91c8a899e9abb35ea082e625e219/family1 in testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:33,810 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/5b6ae7c976314723827e4f82a3a27d3f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/6f45a8d7ff3d4813b45d3f9446022ee1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1123e3c0319a47068c017070f557fcda, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1c1d3adae8f247069c82056b964bd27b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/b93a7497f91f4399870a4cfcffbb9e31] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp, totalSize=26.7 K 2023-02-10 07:55:33,810 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 5b6ae7c976314723827e4f82a3a27d3f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718196 2023-02-10 07:55:33,810 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 6f45a8d7ff3d4813b45d3f9446022ee1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:33,811 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 1123e3c0319a47068c017070f557fcda, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:33,811 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 1c1d3adae8f247069c82056b964bd27b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723574 2023-02-10 07:55:33,811 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting b93a7497f91f4399870a4cfcffbb9e31, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-10 07:55:33,822 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 744b91c8a899e9abb35ea082e625e219#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:33,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/0b1791a83e884774b49d07239a14e0c9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/2c25151abe2d45349cf59bd324a1d49f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/c5e4e07154f24a7a95a1318704b50a59, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/3fa8681ae5d94986b0b34484534aeab8, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/4a791d1979604940a93dd8988e439a88] to archive 2023-02-10 07:55:33,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:33,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/0b1791a83e884774b49d07239a14e0c9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/0b1791a83e884774b49d07239a14e0c9 2023-02-10 07:55:33,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/2c25151abe2d45349cf59bd324a1d49f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/2c25151abe2d45349cf59bd324a1d49f 2023-02-10 07:55:33,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/c5e4e07154f24a7a95a1318704b50a59 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/c5e4e07154f24a7a95a1318704b50a59 2023-02-10 07:55:33,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/3fa8681ae5d94986b0b34484534aeab8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/3fa8681ae5d94986b0b34484534aeab8 2023-02-10 07:55:33,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/4a791d1979604940a93dd8988e439a88 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/4a791d1979604940a93dd8988e439a88 2023-02-10 07:55:34,230 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302102e24976b17354e2b8efac42d69fa651b_del 2023-02-10 07:55:34,230 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302102e24976b17354e2b8efac42d69fa651b_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302102e24976b17354e2b8efac42d69fa651b_del 2023-02-10 07:55:35,044 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8becb0f5c44491dbccb2780b0f8a99c 2023-02-10 07:55:35,044 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/f8becb0f5c44491dbccb2780b0f8a99c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/f8becb0f5c44491dbccb2780b0f8a99c 2023-02-10 07:55:35,048 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8becb0f5c44491dbccb2780b0f8a99c 2023-02-10 07:55:35,049 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 744b91c8a899e9abb35ea082e625e219/family1 of 744b91c8a899e9abb35ea082e625e219 into f8becb0f5c44491dbccb2780b0f8a99c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:35,049 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:35,049 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:35,049 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 744b91c8a899e9abb35ea082e625e219/family2 is initiating major compaction (all files) 2023-02-10 07:55:35,049 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:35,049 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:35,049 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 744b91c8a899e9abb35ea082e625e219/family2 in testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:35,049 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/13c047cdc7814849998094e93d74da3c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/fc2e0af0eb924c2c9f2e7cba74673d9d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/420f88f654bb42cf828a7ba59c8d81f5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/b283ad650c844dfe8092e25b8a577ef4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/04504c3593da484b958e700dbb6d9eaf] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp, totalSize=25.4 K 2023-02-10 07:55:35,050 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 13c047cdc7814849998094e93d74da3c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718196 2023-02-10 07:55:35,050 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting fc2e0af0eb924c2c9f2e7cba74673d9d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:35,050 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 420f88f654bb42cf828a7ba59c8d81f5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:35,051 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting b283ad650c844dfe8092e25b8a577ef4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723574 2023-02-10 07:55:35,051 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 04504c3593da484b958e700dbb6d9eaf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-10 07:55:35,061 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 744b91c8a899e9abb35ea082e625e219#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:35,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/5b6ae7c976314723827e4f82a3a27d3f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/6f45a8d7ff3d4813b45d3f9446022ee1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1123e3c0319a47068c017070f557fcda, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1c1d3adae8f247069c82056b964bd27b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/b93a7497f91f4399870a4cfcffbb9e31] to archive 2023-02-10 07:55:35,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:35,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/5b6ae7c976314723827e4f82a3a27d3f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/5b6ae7c976314723827e4f82a3a27d3f 2023-02-10 07:55:35,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/6f45a8d7ff3d4813b45d3f9446022ee1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/6f45a8d7ff3d4813b45d3f9446022ee1 2023-02-10 07:55:35,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1123e3c0319a47068c017070f557fcda to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1123e3c0319a47068c017070f557fcda 2023-02-10 07:55:35,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1c1d3adae8f247069c82056b964bd27b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/1c1d3adae8f247069c82056b964bd27b 2023-02-10 07:55:35,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/b93a7497f91f4399870a4cfcffbb9e31 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/b93a7497f91f4399870a4cfcffbb9e31 2023-02-10 07:55:35,469 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230210a013638e5b424ba98e2ffb8a02791d78_del 2023-02-10 07:55:35,469 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210a013638e5b424ba98e2ffb8a02791d78_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230210a013638e5b424ba98e2ffb8a02791d78_del 2023-02-10 07:55:36,282 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a75994e91bd41fab3fbbb323a5e4614 2023-02-10 07:55:36,283 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/8a75994e91bd41fab3fbbb323a5e4614 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/8a75994e91bd41fab3fbbb323a5e4614 2023-02-10 07:55:36,286 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8a75994e91bd41fab3fbbb323a5e4614 2023-02-10 07:55:36,287 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 744b91c8a899e9abb35ea082e625e219/family2 of 744b91c8a899e9abb35ea082e625e219 into 8a75994e91bd41fab3fbbb323a5e4614(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:36,287 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:36,288 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:36,288 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): ff8b684a362b59eaec4d1812a47bc303/family1 is initiating major compaction (all files) 2023-02-10 07:55:36,288 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:36,288 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:36,288 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of ff8b684a362b59eaec4d1812a47bc303/family1 in testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:36,288 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/a3ff78ff236442e9a2c297e9dc2e2fef, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d338b24d69224058a6ff07d6021f4720, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/5855fcb31ee84865a837469e36054852, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d10dd022c4db4600b9109970843796d1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/77678c9ca9854f42970baff543ca5345] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp, totalSize=26.7 K 2023-02-10 07:55:36,288 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting a3ff78ff236442e9a2c297e9dc2e2fef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718197 2023-02-10 07:55:36,289 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting d338b24d69224058a6ff07d6021f4720, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:36,289 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 5855fcb31ee84865a837469e36054852, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:36,290 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting d10dd022c4db4600b9109970843796d1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723574 2023-02-10 07:55:36,290 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 77678c9ca9854f42970baff543ca5345, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-10 07:55:36,300 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): ff8b684a362b59eaec4d1812a47bc303#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:36,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/13c047cdc7814849998094e93d74da3c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/fc2e0af0eb924c2c9f2e7cba74673d9d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/420f88f654bb42cf828a7ba59c8d81f5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/b283ad650c844dfe8092e25b8a577ef4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/04504c3593da484b958e700dbb6d9eaf] to archive 2023-02-10 07:55:36,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:36,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/13c047cdc7814849998094e93d74da3c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/13c047cdc7814849998094e93d74da3c 2023-02-10 07:55:36,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/fc2e0af0eb924c2c9f2e7cba74673d9d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/fc2e0af0eb924c2c9f2e7cba74673d9d 2023-02-10 07:55:36,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/420f88f654bb42cf828a7ba59c8d81f5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/420f88f654bb42cf828a7ba59c8d81f5 2023-02-10 07:55:36,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/b283ad650c844dfe8092e25b8a577ef4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/b283ad650c844dfe8092e25b8a577ef4 2023-02-10 07:55:36,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/04504c3593da484b958e700dbb6d9eaf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/04504c3593da484b958e700dbb6d9eaf 2023-02-10 07:55:36,707 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302100683ed1a79844034ae5d3a8330972e96_del 2023-02-10 07:55:36,707 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302100683ed1a79844034ae5d3a8330972e96_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302100683ed1a79844034ae5d3a8330972e96_del 2023-02-10 07:55:37,521 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8bbf82a661a46628ba15d0cc58b8944 2023-02-10 07:55:37,522 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/c8bbf82a661a46628ba15d0cc58b8944 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c8bbf82a661a46628ba15d0cc58b8944 2023-02-10 07:55:37,525 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8bbf82a661a46628ba15d0cc58b8944 2023-02-10 07:55:37,526 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ff8b684a362b59eaec4d1812a47bc303/family1 of ff8b684a362b59eaec4d1812a47bc303 into c8bbf82a661a46628ba15d0cc58b8944(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:37,526 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:37,526 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:37,526 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): ff8b684a362b59eaec4d1812a47bc303/family2 is initiating major compaction (all files) 2023-02-10 07:55:37,526 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:37,526 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:37,527 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of ff8b684a362b59eaec4d1812a47bc303/family2 in testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:37,527 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/6d30111acff54bf49981eca22dbdc6e5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b3581b3afa09420ab9bfd09de18d3148, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b312503929a24983b678fe125e4a21ca, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/4e55935655e2495192354bfc8f7d9b30] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp, totalSize=25.4 K 2023-02-10 07:55:37,527 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 6d30111acff54bf49981eca22dbdc6e5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718197 2023-02-10 07:55:37,528 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting b3581b3afa09420ab9bfd09de18d3148, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:37,528 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting deb2ed4d7ca243a5b3b5c2b9a1adfe7a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:37,529 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting b312503929a24983b678fe125e4a21ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723574 2023-02-10 07:55:37,529 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 4e55935655e2495192354bfc8f7d9b30, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-10 07:55:37,539 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): ff8b684a362b59eaec4d1812a47bc303#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:37,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/a3ff78ff236442e9a2c297e9dc2e2fef, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d338b24d69224058a6ff07d6021f4720, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/5855fcb31ee84865a837469e36054852, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d10dd022c4db4600b9109970843796d1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/77678c9ca9854f42970baff543ca5345] to archive 2023-02-10 07:55:37,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:37,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/a3ff78ff236442e9a2c297e9dc2e2fef to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/a3ff78ff236442e9a2c297e9dc2e2fef 2023-02-10 07:55:37,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d338b24d69224058a6ff07d6021f4720 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d338b24d69224058a6ff07d6021f4720 2023-02-10 07:55:37,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/5855fcb31ee84865a837469e36054852 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/5855fcb31ee84865a837469e36054852 2023-02-10 07:55:37,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d10dd022c4db4600b9109970843796d1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/d10dd022c4db4600b9109970843796d1 2023-02-10 07:55:37,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/77678c9ca9854f42970baff543ca5345 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/77678c9ca9854f42970baff543ca5345 2023-02-10 07:55:37,948 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302108b2e8583e2204ef3a99e1ec58333ffe2_del 2023-02-10 07:55:37,948 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302108b2e8583e2204ef3a99e1ec58333ffe2_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302108b2e8583e2204ef3a99e1ec58333ffe2_del 2023-02-10 07:55:38,761 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de9d77ac9b014583be9309883df5928e 2023-02-10 07:55:38,761 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/de9d77ac9b014583be9309883df5928e as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/de9d77ac9b014583be9309883df5928e 2023-02-10 07:55:38,765 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de9d77ac9b014583be9309883df5928e 2023-02-10 07:55:38,766 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ff8b684a362b59eaec4d1812a47bc303/family2 of ff8b684a362b59eaec4d1812a47bc303 into de9d77ac9b014583be9309883df5928e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:38,766 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:38,771 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:38,774 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:38,779 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:38,780 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:38,787 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-10 07:55:38,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/6d30111acff54bf49981eca22dbdc6e5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b3581b3afa09420ab9bfd09de18d3148, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b312503929a24983b678fe125e4a21ca, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/4e55935655e2495192354bfc8f7d9b30] to archive 2023-02-10 07:55:38,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:38,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/6d30111acff54bf49981eca22dbdc6e5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/6d30111acff54bf49981eca22dbdc6e5 2023-02-10 07:55:38,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b3581b3afa09420ab9bfd09de18d3148 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b3581b3afa09420ab9bfd09de18d3148 2023-02-10 07:55:38,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/deb2ed4d7ca243a5b3b5c2b9a1adfe7a 2023-02-10 07:55:38,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b312503929a24983b678fe125e4a21ca to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/b312503929a24983b678fe125e4a21ca 2023-02-10 07:55:38,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/4e55935655e2495192354bfc8f7d9b30 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/4e55935655e2495192354bfc8f7d9b30 2023-02-10 07:55:38,820 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-10 07:55:38,823 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021085672e86802648a885b16dd09da5088c_del 2023-02-10 07:55:38,826 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302102e24976b17354e2b8efac42d69fa651b_del 2023-02-10 07:55:38,829 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302100683ed1a79844034ae5d3a8330972e96_del 2023-02-10 07:55:38,830 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:38,830 DEBUG [Listener at localhost/46793] zookeeper.ReadOnlyZKClient(139): Connect 0x78e7e520 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:55:38,835 DEBUG [Listener at localhost/46793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f1d5058, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:55:38,836 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:38,836 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:38,836 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:39,696 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302103b6da5b86f4e42bdbb968a30f4411932 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302103b6da5b86f4e42bdbb968a30f4411932 2023-02-10 07:55:39,696 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210afe309bbd32d430ebc3c1e12ac98465f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210afe309bbd32d430ebc3c1e12ac98465f 2023-02-10 07:55:39,697 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:39,697 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:39,705 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210d5d7d39e4b4d446f81901c30ba3fb3a2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210d5d7d39e4b4d446f81901c30ba3fb3a2 2023-02-10 07:55:39,706 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:39,710 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:55:39,715 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37176, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:55:39,729 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:55:39,736 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42230, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:55:39,754 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210/family1/7532a75b5081422faa9845cac1dd37ec first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-10 07:55:39,754 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210/family1/c039bb754dd94ebf9c9a85f9032c1384 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-10 07:55:39,755 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210/family1/7532a75b5081422faa9845cac1dd37ec}] 2023-02-10 07:55:39,756 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210/family1/c039bb754dd94ebf9c9a85f9032c1384}] 2023-02-10 07:55:39,757 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210/family1/40a4632ee68549e39fc8fa95eca033e2 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-10 07:55:39,758 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210/family1/40a4632ee68549e39fc8fa95eca033e2}] 2023-02-10 07:55:39,761 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210/family1/7532a75b5081422faa9845cac1dd37ec for inclusion in 3193ddb2777ba7768b31c482473b0c2d/family1 2023-02-10 07:55:39,761 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210/family1/c039bb754dd94ebf9c9a85f9032c1384 for inclusion in 744b91c8a899e9abb35ea082e625e219/family1 2023-02-10 07:55:39,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210/family1/40a4632ee68549e39fc8fa95eca033e2 for inclusion in ff8b684a362b59eaec4d1812a47bc303/family1 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last=1 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:39,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:39,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210/family1/40a4632ee68549e39fc8fa95eca033e2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__nq5mfkm5nk26h319cgm5heh14ujkg8ue2ce5jailk1l338rm6omn5n6gsk480l46/family1/40a4632ee68549e39fc8fa95eca033e2 2023-02-10 07:55:39,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210/family1/c039bb754dd94ebf9c9a85f9032c1384 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__j5rsid9r6at36733ctahdn3ail7ssbgb7e92e4bk41o32kivo85m61bfcg3itq2i/family1/c039bb754dd94ebf9c9a85f9032c1384 2023-02-10 07:55:39,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210/family1/7532a75b5081422faa9845cac1dd37ec to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__eq62mk5q8014q1u5ir6ga6mmr4pjttvftr1hqq8lq814jnsmc2lrf82qk0jhfpue/family1/7532a75b5081422faa9845cac1dd37ec 2023-02-10 07:55:39,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__nq5mfkm5nk26h319cgm5heh14ujkg8ue2ce5jailk1l338rm6omn5n6gsk480l46/family1/40a4632ee68549e39fc8fa95eca033e2 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c2d6dbc9d2974c6cb5b462cc5bd59725_SeqId_29_ 2023-02-10 07:55:39,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__j5rsid9r6at36733ctahdn3ail7ssbgb7e92e4bk41o32kivo85m61bfcg3itq2i/family1/c039bb754dd94ebf9c9a85f9032c1384 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/0aedee22c80e4717ba0df026f88d8fc4_SeqId_29_ 2023-02-10 07:55:39,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__nq5mfkm5nk26h319cgm5heh14ujkg8ue2ce5jailk1l338rm6omn5n6gsk480l46/family1/40a4632ee68549e39fc8fa95eca033e2 into ff8b684a362b59eaec4d1812a47bc303/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c2d6dbc9d2974c6cb5b462cc5bd59725_SeqId_29_ - updating store file list. 2023-02-10 07:55:39,766 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__j5rsid9r6at36733ctahdn3ail7ssbgb7e92e4bk41o32kivo85m61bfcg3itq2i/family1/c039bb754dd94ebf9c9a85f9032c1384 into 744b91c8a899e9abb35ea082e625e219/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/0aedee22c80e4717ba0df026f88d8fc4_SeqId_29_ - updating store file list. 2023-02-10 07:55:39,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__eq62mk5q8014q1u5ir6ga6mmr4pjttvftr1hqq8lq814jnsmc2lrf82qk0jhfpue/family1/7532a75b5081422faa9845cac1dd37ec as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/a037c78c0d73482e87066f998130cc45_SeqId_29_ 2023-02-10 07:55:39,767 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__eq62mk5q8014q1u5ir6ga6mmr4pjttvftr1hqq8lq814jnsmc2lrf82qk0jhfpue/family1/7532a75b5081422faa9845cac1dd37ec into 3193ddb2777ba7768b31c482473b0c2d/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/a037c78c0d73482e87066f998130cc45_SeqId_29_ - updating store file list. 2023-02-10 07:55:39,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c2d6dbc9d2974c6cb5b462cc5bd59725_SeqId_29_ into ff8b684a362b59eaec4d1812a47bc303/family1 2023-02-10 07:55:39,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__nq5mfkm5nk26h319cgm5heh14ujkg8ue2ce5jailk1l338rm6omn5n6gsk480l46/family1/40a4632ee68549e39fc8fa95eca033e2 into ff8b684a362b59eaec4d1812a47bc303/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c2d6dbc9d2974c6cb5b462cc5bd59725_SeqId_29_) 2023-02-10 07:55:39,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__nq5mfkm5nk26h319cgm5heh14ujkg8ue2ce5jailk1l338rm6omn5n6gsk480l46/family1/40a4632ee68549e39fc8fa95eca033e2 2023-02-10 07:55:39,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/0aedee22c80e4717ba0df026f88d8fc4_SeqId_29_ into 744b91c8a899e9abb35ea082e625e219/family1 2023-02-10 07:55:39,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__j5rsid9r6at36733ctahdn3ail7ssbgb7e92e4bk41o32kivo85m61bfcg3itq2i/family1/c039bb754dd94ebf9c9a85f9032c1384 into 744b91c8a899e9abb35ea082e625e219/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/0aedee22c80e4717ba0df026f88d8fc4_SeqId_29_) 2023-02-10 07:55:39,771 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/a037c78c0d73482e87066f998130cc45_SeqId_29_ into 3193ddb2777ba7768b31c482473b0c2d/family1 2023-02-10 07:55:39,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__j5rsid9r6at36733ctahdn3ail7ssbgb7e92e4bk41o32kivo85m61bfcg3itq2i/family1/c039bb754dd94ebf9c9a85f9032c1384 2023-02-10 07:55:39,771 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__eq62mk5q8014q1u5ir6ga6mmr4pjttvftr1hqq8lq814jnsmc2lrf82qk0jhfpue/family1/7532a75b5081422faa9845cac1dd37ec into 3193ddb2777ba7768b31c482473b0c2d/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/a037c78c0d73482e87066f998130cc45_SeqId_29_) 2023-02-10 07:55:39,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__eq62mk5q8014q1u5ir6ga6mmr4pjttvftr1hqq8lq814jnsmc2lrf82qk0jhfpue/family1/7532a75b5081422faa9845cac1dd37ec 2023-02-10 07:55:39,772 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:39,773 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:39,773 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:39,773 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:39,773 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:39,773 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:39,774 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201 2023-02-10 07:55:39,775 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4 2023-02-10 07:55:39,775 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1 2023-02-10 07:55:39,776 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce 2023-02-10 07:55:39,776 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d 2023-02-10 07:55:39,776 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4 2023-02-10 07:55:39,777 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318 2023-02-10 07:55:39,777 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d 2023-02-10 07:55:39,777 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8 2023-02-10 07:55:39,778 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02 2023-02-10 07:55:39,778 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-10 07:55:39,778 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210' 2023-02-10 07:55:39,778 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a 2023-02-10 07:55:39,778 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:39,778 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-10 07:55:39,778 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210' 2023-02-10 07:55:39,780 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6 2023-02-10 07:55:39,780 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-10 07:55:39,780 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210' 2023-02-10 07:55:39,780 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:39,780 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:39,780 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:39,780 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:39,780 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021085672e86802648a885b16dd09da5088c_del] 2023-02-10 07:55:39,781 DEBUG [Listener at localhost/46793] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:39,782 DEBUG [Listener at localhost/46793] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021085672e86802648a885b16dd09da5088c_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021085672e86802648a885b16dd09da5088c_del 2023-02-10 07:55:39,782 INFO [Listener at localhost/46793] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-10 07:55:39,782 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302102e24976b17354e2b8efac42d69fa651b_del] 2023-02-10 07:55:39,782 DEBUG [Listener at localhost/46793] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:39,783 DEBUG [Listener at localhost/46793] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302102e24976b17354e2b8efac42d69fa651b_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302102e24976b17354e2b8efac42d69fa651b_del 2023-02-10 07:55:39,783 INFO [Listener at localhost/46793] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-10 07:55:39,784 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302100683ed1a79844034ae5d3a8330972e96_del] 2023-02-10 07:55:39,784 DEBUG [Listener at localhost/46793] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:39,785 DEBUG [Listener at localhost/46793] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302100683ed1a79844034ae5d3a8330972e96_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302100683ed1a79844034ae5d3a8330972e96_del 2023-02-10 07:55:39,785 INFO [Listener at localhost/46793] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-10 07:55:39,787 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:39,789 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:39,792 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:39,793 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:39,798 INFO [Listener at localhost/46793] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-10 07:55:39,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-02-10 07:55:39,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-10 07:55:39,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-10 07:55:39,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015739802"}]},"ts":"1676015739802"} 2023-02-10 07:55:39,803 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-10 07:55:39,804 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-10 07:55:39,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, UNASSIGN}] 2023-02-10 07:55:39,806 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, UNASSIGN 2023-02-10 07:55:39,806 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, UNASSIGN 2023-02-10 07:55:39,806 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, UNASSIGN 2023-02-10 07:55:39,806 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=744b91c8a899e9abb35ea082e625e219, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:39,807 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=3193ddb2777ba7768b31c482473b0c2d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:39,806 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=ff8b684a362b59eaec4d1812a47bc303, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:39,807 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015739806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015739806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015739806"}]},"ts":"1676015739806"} 2023-02-10 07:55:39,807 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015739807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015739807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015739807"}]},"ts":"1676015739807"} 2023-02-10 07:55:39,807 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015739806"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015739806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015739806"}]},"ts":"1676015739806"} 2023-02-10 07:55:39,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 744b91c8a899e9abb35ea082e625e219, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:39,808 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 3193ddb2777ba7768b31c482473b0c2d, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:39,809 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure ff8b684a362b59eaec4d1812a47bc303, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:39,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-10 07:55:39,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:39,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ff8b684a362b59eaec4d1812a47bc303, disabling compactions & flushes 2023-02-10 07:55:39,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:39,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:39,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. after waiting 0 ms 2023-02-10 07:55:39,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:39,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-10 07:55:39,965 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:39,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ff8b684a362b59eaec4d1812a47bc303: Waiting for close lock at 1676015739960Running coprocessor pre-close hooks at 1676015739960Disabling compacts and flushes for region at 1676015739960Disabling writes for close at 1676015739960Writing region close event to WAL at 1676015739961 (+1 ms)Running coprocessor post-close hooks at 1676015739964 (+3 ms)Closed at 1676015739965 (+1 ms) 2023-02-10 07:55:39,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:39,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:39,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 744b91c8a899e9abb35ea082e625e219, disabling compactions & flushes 2023-02-10 07:55:39,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:39,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:39,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. after waiting 0 ms 2023-02-10 07:55:39,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:39,967 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=ff8b684a362b59eaec4d1812a47bc303, regionState=CLOSED 2023-02-10 07:55:39,967 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015739967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015739967"}]},"ts":"1676015739967"} 2023-02-10 07:55:39,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-02-10 07:55:39,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure ff8b684a362b59eaec4d1812a47bc303, server=jenkins-hbase4.apache.org,36907,1676015618909 in 159 msec 2023-02-10 07:55:39,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-10 07:55:39,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, UNASSIGN in 165 msec 2023-02-10 07:55:39,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:39,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 744b91c8a899e9abb35ea082e625e219: Waiting for close lock at 1676015739967Running coprocessor pre-close hooks at 1676015739967Disabling compacts and flushes for region at 1676015739967Disabling writes for close at 1676015739967Writing region close event to WAL at 1676015739968 (+1 ms)Running coprocessor post-close hooks at 1676015739971 (+3 ms)Closed at 1676015739971 2023-02-10 07:55:39,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:39,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:39,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3193ddb2777ba7768b31c482473b0c2d, disabling compactions & flushes 2023-02-10 07:55:39,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:39,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:39,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. after waiting 0 ms 2023-02-10 07:55:39,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:39,973 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=744b91c8a899e9abb35ea082e625e219, regionState=CLOSED 2023-02-10 07:55:39,973 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015739973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015739973"}]},"ts":"1676015739973"} 2023-02-10 07:55:39,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-02-10 07:55:39,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 744b91c8a899e9abb35ea082e625e219, server=jenkins-hbase4.apache.org,36907,1676015618909 in 166 msec 2023-02-10 07:55:39,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, UNASSIGN in 170 msec 2023-02-10 07:55:39,977 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-10 07:55:39,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:39,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3193ddb2777ba7768b31c482473b0c2d: Waiting for close lock at 1676015739973Running coprocessor pre-close hooks at 1676015739973Disabling compacts and flushes for region at 1676015739973Disabling writes for close at 1676015739973Writing region close event to WAL at 1676015739974 (+1 ms)Running coprocessor post-close hooks at 1676015739977 (+3 ms)Closed at 1676015739978 (+1 ms) 2023-02-10 07:55:39,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:39,979 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=3193ddb2777ba7768b31c482473b0c2d, regionState=CLOSED 2023-02-10 07:55:39,979 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015739979"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015739979"}]},"ts":"1676015739979"} 2023-02-10 07:55:39,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-02-10 07:55:39,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 3193ddb2777ba7768b31c482473b0c2d, server=jenkins-hbase4.apache.org,36907,1676015618909 in 172 msec 2023-02-10 07:55:39,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-02-10 07:55:39,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, UNASSIGN in 176 msec 2023-02-10 07:55:39,983 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015739983"}]},"ts":"1676015739983"} 2023-02-10 07:55:39,984 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-10 07:55:39,986 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-10 07:55:39,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 187 msec 2023-02-10 07:55:40,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-10 07:55:40,104 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-10 07:55:40,114 INFO [Listener at localhost/46793] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676015725367-1676015740114 2023-02-10 07:55:40,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-10 07:55:40,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676015740114 (current time:1676015740115). 2023-02-10 07:55:40,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-10 07:55:40,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] zookeeper.ReadOnlyZKClient(139): Connect 0x6e5cf4e0 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:55:40,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d442a38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:55:40,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:55:40,122 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:55:40,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e5cf4e0 to 127.0.0.1:54857 2023-02-10 07:55:40,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:40,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-10 07:55:40,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-10 07:55:40,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-10 07:55:40,125 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-10 07:55:40,126 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676016340126 2023-02-10 07:55:40,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-10 07:55:40,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676015725367-1676015740114 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-10 07:55:40,126 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:40,126 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-10 07:55:40,227 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:40,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:40,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:40,231 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-10 07:55:40,431 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:40,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:40,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:40,432 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-10 07:55:40,445 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-10 07:55:40,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-10 07:55:40,534 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-10 07:55:40,534 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-10 07:55:40,534 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-10 07:55:40,534 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-10 07:55:40,534 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-10 07:55:40,534 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-10 07:55:40,534 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-10 07:55:40,534 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-10 07:55:40,536 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/895abce1217940239fa1f29d682d98d9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/a037c78c0d73482e87066f998130cc45_SeqId_29_] hfiles 2023-02-10 07:55:40,536 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/895abce1217940239fa1f29d682d98d9 2023-02-10 07:55:40,536 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/0aedee22c80e4717ba0df026f88d8fc4_SeqId_29_, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/f8becb0f5c44491dbccb2780b0f8a99c] hfiles 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c2d6dbc9d2974c6cb5b462cc5bd59725_SeqId_29_, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c8bbf82a661a46628ba15d0cc58b8944] hfiles 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/0aedee22c80e4717ba0df026f88d8fc4_SeqId_29_ 2023-02-10 07:55:40,536 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/a037c78c0d73482e87066f998130cc45_SeqId_29_ 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/f8becb0f5c44491dbccb2780b0f8a99c 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c2d6dbc9d2974c6cb5b462cc5bd59725_SeqId_29_ 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c8bbf82a661a46628ba15d0cc58b8944 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302103b6da5b86f4e42bdbb968a30f4411932, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210afe309bbd32d430ebc3c1e12ac98465f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210d5d7d39e4b4d446f81901c30ba3fb3a2] hfiles 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302103b6da5b86f4e42bdbb968a30f4411932 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210afe309bbd32d430ebc3c1e12ac98465f 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210d5d7d39e4b4d446f81901c30ba3fb3a2 2023-02-10 07:55:40,537 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/8a75994e91bd41fab3fbbb323a5e4614] hfiles 2023-02-10 07:55:40,538 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/8a75994e91bd41fab3fbbb323a5e4614 2023-02-10 07:55:40,538 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/64d4e37061ee4eb98b888e09f02ed56f] hfiles 2023-02-10 07:55:40,538 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/de9d77ac9b014583be9309883df5928e] hfiles 2023-02-10 07:55:40,538 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/64d4e37061ee4eb98b888e09f02ed56f 2023-02-10 07:55:40,538 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/de9d77ac9b014583be9309883df5928e 2023-02-10 07:55:40,543 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100b446da8140646c8a0dff1f2477f4a76, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100d0a6c20a1b14655be63d83c86f4a7df, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302102608f22ddd3247a5b078981aa136de18, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302107a00e4b710b449bca145f265fd06dd31, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230210a013638e5b424ba98e2ffb8a02791d78_del, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021073345ed1a7cb4e139b419ce6c0f4945c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210827ce867693b4bcb993f682692d25e11, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302108b2e8583e2204ef3a99e1ec58333ffe2_del, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021096857228cc0c4720b5b6d6d012defe5e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210a7093ca64eb1497cad0d1388139975d3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302102c94863126fa476699d03e2bd2a5c319, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210643ae3c5cc8a4ce69c2fb221d81608e4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021073a0caa9fbe34f36b439ec0575322587_del, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210ba0334cc870840278f9a3654df1654e2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210bee2141775e44b34adb06a3f01cb8ee0] hfiles 2023-02-10 07:55:40,543 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100b446da8140646c8a0dff1f2477f4a76 2023-02-10 07:55:40,543 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302100d0a6c20a1b14655be63d83c86f4a7df 2023-02-10 07:55:40,543 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302102608f22ddd3247a5b078981aa136de18 2023-02-10 07:55:40,543 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302107a00e4b710b449bca145f265fd06dd31 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230210a013638e5b424ba98e2ffb8a02791d78_del 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021073345ed1a7cb4e139b419ce6c0f4945c 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210827ce867693b4bcb993f682692d25e11 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302108b2e8583e2204ef3a99e1ec58333ffe2_del 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021096857228cc0c4720b5b6d6d012defe5e 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230210a7093ca64eb1497cad0d1388139975d3 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302102c94863126fa476699d03e2bd2a5c319 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210643ae3c5cc8a4ce69c2fb221d81608e4 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021073a0caa9fbe34f36b439ec0575322587_del 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210ba0334cc870840278f9a3654df1654e2 2023-02-10 07:55:40,544 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230210bee2141775e44b34adb06a3f01cb8ee0 2023-02-10 07:55:40,732 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:40,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:40,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:40,733 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-10 07:55:40,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-10 07:55:40,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676015725367-1676015740114 2023-02-10 07:55:40,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676015725367-1676015740114 2023-02-10 07:55:41,234 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:41,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:41,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-10 07:55:41,235 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-10 07:55:41,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676015725367-1676015740114 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/hbase-failsafe-snaptb-1676015725367-1676015740114 2023-02-10 07:55:42,188 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676015725367-1676015740114 of table testCompactionWithHFileLink completed 2023-02-10 07:55:42,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676015725367-1676015740114 2023-02-10 07:55:42,189 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676015725367-1676015740114 2023-02-10 07:55:42,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676015725367-1676015740114 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676015740126Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676015740532 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676015725367-1676015740114 at 1676015740949 (+417 ms)Loading Region manifests for hbase-failsafe-snaptb-1676015725367-1676015740114 at 1676015740950 (+1 ms)Writing data manifest for hbase-failsafe-snaptb-1676015725367-1676015740114 at 1676015740952 (+2 ms)Verifying snapshot: hbase-failsafe-snaptb-1676015725367-1676015740114 at 1676015741358 (+406 ms)Snapshot hbase-failsafe-snaptb-1676015725367-1676015740114 of table testCompactionWithHFileLink completed at 1676015742188 (+830 ms) 2023-02-10 07:55:42,190 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-10 07:55:42,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0660 sec 2023-02-10 07:55:42,235 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-10 07:55:42,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-10 07:55:42,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676015725367-1676015740114 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-10 07:55:42,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676015725367" table: "testCompactionWithHFileLink" creation_time: 1676015725376 type: FLUSH version: 2 ttl: 0 ) 2023-02-10 07:55:42,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676015725367 as table=testCompactionWithHFileLink 2023-02-10 07:55:42,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-10 07:55:42,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-10 07:55:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-10 07:55:42,693 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-10 07:55:42,693 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-10 07:55:42,694 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-10 07:55:42,694 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-10 07:55:42,699 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676015725367" table: "testCompactionWithHFileLink" creation_time: 1676015725376 type: FLUSH version: 2 ttl: 0 2023-02-10 07:55:42,699 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink 2023-02-10 07:55:42,703 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-10 07:55:42,707 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210afe309bbd32d430ebc3c1e12ac98465f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230210afe309bbd32d430ebc3c1e12ac98465f 2023-02-10 07:55:42,708 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210d5d7d39e4b4d446f81901c30ba3fb3a2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210d5d7d39e4b4d446f81901c30ba3fb3a2 2023-02-10 07:55:42,709 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302103b6da5b86f4e42bdbb968a30f4411932 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302103b6da5b86f4e42bdbb968a30f4411932 2023-02-10 07:55:42,709 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1 of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,712 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,715 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,718 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,720 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201 of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,723 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,726 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318 of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,728 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02 of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,731 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4 of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,734 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4 of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,737 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8 of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,740 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6 of snapshot=snaptb-1676015725367 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-10 07:55:42,745 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302108b2e8583e2204ef3a99e1ec58333ffe2_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302108b2e8583e2204ef3a99e1ec58333ffe2_del 2023-02-10 07:55:42,746 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230210a013638e5b424ba98e2ffb8a02791d78_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230210a013638e5b424ba98e2ffb8a02791d78_del 2023-02-10 07:55:42,747 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021073a0caa9fbe34f36b439ec0575322587_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021073a0caa9fbe34f36b439ec0575322587_del 2023-02-10 07:55:42,747 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:42,747 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:42,747 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:42,751 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/a037c78c0d73482e87066f998130cc45_SeqId_29_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/a037c78c0d73482e87066f998130cc45_SeqId_29_ 2023-02-10 07:55:42,751 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c2d6dbc9d2974c6cb5b462cc5bd59725_SeqId_29_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c2d6dbc9d2974c6cb5b462cc5bd59725_SeqId_29_ 2023-02-10 07:55:42,752 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/f8becb0f5c44491dbccb2780b0f8a99c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/f8becb0f5c44491dbccb2780b0f8a99c 2023-02-10 07:55:42,754 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/895abce1217940239fa1f29d682d98d9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/895abce1217940239fa1f29d682d98d9 2023-02-10 07:55:42,754 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 32a1fdc2f81246ac907f976ad1ea613b of snapshot=snaptb-1676015725367 to region=3193ddb2777ba7768b31c482473b0c2d table=testCompactionWithHFileLink 2023-02-10 07:55:42,754 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c8bbf82a661a46628ba15d0cc58b8944 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/c8bbf82a661a46628ba15d0cc58b8944 2023-02-10 07:55:42,754 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a3ff78ff236442e9a2c297e9dc2e2fef of snapshot=snaptb-1676015725367 to region=ff8b684a362b59eaec4d1812a47bc303 table=testCompactionWithHFileLink 2023-02-10 07:55:42,754 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/0aedee22c80e4717ba0df026f88d8fc4_SeqId_29_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/0aedee22c80e4717ba0df026f88d8fc4_SeqId_29_ 2023-02-10 07:55:42,754 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5b6ae7c976314723827e4f82a3a27d3f of snapshot=snaptb-1676015725367 to region=744b91c8a899e9abb35ea082e625e219 table=testCompactionWithHFileLink 2023-02-10 07:55:42,761 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7775dfe813fb4288a79d444dad06e8bf of snapshot=snaptb-1676015725367 to region=3193ddb2777ba7768b31c482473b0c2d table=testCompactionWithHFileLink 2023-02-10 07:55:42,761 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6f45a8d7ff3d4813b45d3f9446022ee1 of snapshot=snaptb-1676015725367 to region=744b91c8a899e9abb35ea082e625e219 table=testCompactionWithHFileLink 2023-02-10 07:55:42,761 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d338b24d69224058a6ff07d6021f4720 of snapshot=snaptb-1676015725367 to region=ff8b684a362b59eaec4d1812a47bc303 table=testCompactionWithHFileLink 2023-02-10 07:55:42,764 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1123e3c0319a47068c017070f557fcda of snapshot=snaptb-1676015725367 to region=744b91c8a899e9abb35ea082e625e219 table=testCompactionWithHFileLink 2023-02-10 07:55:42,765 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 266bcb1710b047babae31ba9f5f50683 of snapshot=snaptb-1676015725367 to region=3193ddb2777ba7768b31c482473b0c2d table=testCompactionWithHFileLink 2023-02-10 07:55:42,765 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5855fcb31ee84865a837469e36054852 of snapshot=snaptb-1676015725367 to region=ff8b684a362b59eaec4d1812a47bc303 table=testCompactionWithHFileLink 2023-02-10 07:55:42,768 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1c1d3adae8f247069c82056b964bd27b of snapshot=snaptb-1676015725367 to region=744b91c8a899e9abb35ea082e625e219 table=testCompactionWithHFileLink 2023-02-10 07:55:42,768 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d10dd022c4db4600b9109970843796d1 of snapshot=snaptb-1676015725367 to region=ff8b684a362b59eaec4d1812a47bc303 table=testCompactionWithHFileLink 2023-02-10 07:55:42,768 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fc7cb9c260a54e7490f34395609725a4 of snapshot=snaptb-1676015725367 to region=3193ddb2777ba7768b31c482473b0c2d table=testCompactionWithHFileLink 2023-02-10 07:55:42,773 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/8a75994e91bd41fab3fbbb323a5e4614 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/8a75994e91bd41fab3fbbb323a5e4614 2023-02-10 07:55:42,773 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 13c047cdc7814849998094e93d74da3c of snapshot=snaptb-1676015725367 to region=744b91c8a899e9abb35ea082e625e219 table=testCompactionWithHFileLink 2023-02-10 07:55:42,776 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/de9d77ac9b014583be9309883df5928e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/de9d77ac9b014583be9309883df5928e 2023-02-10 07:55:42,776 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6d30111acff54bf49981eca22dbdc6e5 of snapshot=snaptb-1676015725367 to region=ff8b684a362b59eaec4d1812a47bc303 table=testCompactionWithHFileLink 2023-02-10 07:55:42,778 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/64d4e37061ee4eb98b888e09f02ed56f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/64d4e37061ee4eb98b888e09f02ed56f 2023-02-10 07:55:42,778 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0b1791a83e884774b49d07239a14e0c9 of snapshot=snaptb-1676015725367 to region=3193ddb2777ba7768b31c482473b0c2d table=testCompactionWithHFileLink 2023-02-10 07:55:42,787 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fc2e0af0eb924c2c9f2e7cba74673d9d of snapshot=snaptb-1676015725367 to region=744b91c8a899e9abb35ea082e625e219 table=testCompactionWithHFileLink 2023-02-10 07:55:42,787 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b3581b3afa09420ab9bfd09de18d3148 of snapshot=snaptb-1676015725367 to region=ff8b684a362b59eaec4d1812a47bc303 table=testCompactionWithHFileLink 2023-02-10 07:55:42,787 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2c25151abe2d45349cf59bd324a1d49f of snapshot=snaptb-1676015725367 to region=3193ddb2777ba7768b31c482473b0c2d table=testCompactionWithHFileLink 2023-02-10 07:55:42,792 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c5e4e07154f24a7a95a1318704b50a59 of snapshot=snaptb-1676015725367 to region=3193ddb2777ba7768b31c482473b0c2d table=testCompactionWithHFileLink 2023-02-10 07:55:42,792 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 420f88f654bb42cf828a7ba59c8d81f5 of snapshot=snaptb-1676015725367 to region=744b91c8a899e9abb35ea082e625e219 table=testCompactionWithHFileLink 2023-02-10 07:55:42,792 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink deb2ed4d7ca243a5b3b5c2b9a1adfe7a of snapshot=snaptb-1676015725367 to region=ff8b684a362b59eaec4d1812a47bc303 table=testCompactionWithHFileLink 2023-02-10 07:55:42,795 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b312503929a24983b678fe125e4a21ca of snapshot=snaptb-1676015725367 to region=ff8b684a362b59eaec4d1812a47bc303 table=testCompactionWithHFileLink 2023-02-10 07:55:42,795 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3fa8681ae5d94986b0b34484534aeab8 of snapshot=snaptb-1676015725367 to region=3193ddb2777ba7768b31c482473b0c2d table=testCompactionWithHFileLink 2023-02-10 07:55:42,795 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b283ad650c844dfe8092e25b8a577ef4 of snapshot=snaptb-1676015725367 to region=744b91c8a899e9abb35ea082e625e219 table=testCompactionWithHFileLink 2023-02-10 07:55:42,799 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676015725367" table: "testCompactionWithHFileLink" creation_time: 1676015725376 type: FLUSH version: 2 ttl: 0 2023-02-10 07:55:42,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676015742800"}]},"ts":"9223372036854775807"} 2023-02-10 07:55:42,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676015742800"}]},"ts":"9223372036854775807"} 2023-02-10 07:55:42,801 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676015742800"}]},"ts":"9223372036854775807"} 2023-02-10 07:55:42,802 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-10 07:55:42,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3193ddb2777ba7768b31c482473b0c2d, NAME => 'testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 744b91c8a899e9abb35ea082e625e219, NAME => 'testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => ff8b684a362b59eaec4d1812a47bc303, NAME => 'testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.', STARTKEY => '2', ENDKEY => ''}] 2023-02-10 07:55:42,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015742801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015742801"}]},"ts":"1676015742801"} 2023-02-10 07:55:42,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015742801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015742801"}]},"ts":"1676015742801"} 2023-02-10 07:55:42,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015742801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015742801"}]},"ts":"1676015742801"} 2023-02-10 07:55:42,804 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-10 07:55:42,804 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-10 07:55:42,804 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 3193ddb2777ba7768b31c482473b0c2d, NAME => 'testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 744b91c8a899e9abb35ea082e625e219, NAME => 'testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => ff8b684a362b59eaec4d1812a47bc303, NAME => 'testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.', STARTKEY => '2', ENDKEY => ''}] 2023-02-10 07:55:42,805 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676015725367 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-10 07:55:42,806 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676015725367" table: "testCompactionWithHFileLink" creation_time: 1676015725376 type: FLUSH version: 2 ttl: 0 ) in 532 msec 2023-02-10 07:55:42,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-10 07:55:42,888 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-10 07:55:42,889 INFO [Listener at localhost/46793] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676015725367-1676015740114 2023-02-10 07:55:42,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1676015725367-1676015740114" 2023-02-10 07:55:42,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676015725367-1676015740114 2023-02-10 07:55:42,897 INFO [Listener at localhost/46793] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-10 07:55:42,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$10(2372): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-02-10 07:55:42,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-10 07:55:42,908 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-10 07:55:42,909 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015742908"}]},"ts":"1676015742908"} 2023-02-10 07:55:42,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-10 07:55:42,910 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-10 07:55:42,912 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-10 07:55:42,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, ASSIGN}] 2023-02-10 07:55:42,913 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, ASSIGN 2023-02-10 07:55:42,913 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, ASSIGN 2023-02-10 07:55:42,913 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, ASSIGN 2023-02-10 07:55:42,914 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-10 07:55:42,914 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-10 07:55:42,914 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-10 07:55:43,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-10 07:55:43,065 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=ff8b684a362b59eaec4d1812a47bc303, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:43,065 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=3193ddb2777ba7768b31c482473b0c2d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:43,065 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=744b91c8a899e9abb35ea082e625e219, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:43,065 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015743065"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015743065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015743065"}]},"ts":"1676015743065"} 2023-02-10 07:55:43,065 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015743065"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015743065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015743065"}]},"ts":"1676015743065"} 2023-02-10 07:55:43,065 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015743065"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015743065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015743065"}]},"ts":"1676015743065"} 2023-02-10 07:55:43,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure ff8b684a362b59eaec4d1812a47bc303, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:43,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 744b91c8a899e9abb35ea082e625e219, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:43,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 3193ddb2777ba7768b31c482473b0c2d, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:43,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-10 07:55:43,221 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:43,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3193ddb2777ba7768b31c482473b0c2d, NAME => 'testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.', STARTKEY => '', ENDKEY => '1'} 2023-02-10 07:55:43,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:43,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:43,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:43,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:43,222 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:43,223 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1 2023-02-10 07:55:43,223 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1 2023-02-10 07:55:43,223 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3193ddb2777ba7768b31c482473b0c2d columnFamilyName family1 2023-02-10 07:55:43,238 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-266bcb1710b047babae31ba9f5f50683 2023-02-10 07:55:43,243 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-32a1fdc2f81246ac907f976ad1ea613b 2023-02-10 07:55:43,248 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-7775dfe813fb4288a79d444dad06e8bf 2023-02-10 07:55:43,253 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-fc7cb9c260a54e7490f34395609725a4 2023-02-10 07:55:43,253 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(310): Store=3193ddb2777ba7768b31c482473b0c2d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:43,254 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:43,255 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2 2023-02-10 07:55:43,255 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2 2023-02-10 07:55:43,255 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3193ddb2777ba7768b31c482473b0c2d columnFamilyName family2 2023-02-10 07:55:43,263 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-0b1791a83e884774b49d07239a14e0c9 2023-02-10 07:55:43,280 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-2c25151abe2d45349cf59bd324a1d49f 2023-02-10 07:55:43,286 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-3fa8681ae5d94986b0b34484534aeab8 2023-02-10 07:55:43,291 DEBUG [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-c5e4e07154f24a7a95a1318704b50a59 2023-02-10 07:55:43,291 INFO [StoreOpener-3193ddb2777ba7768b31c482473b0c2d-1] regionserver.HStore(310): Store=3193ddb2777ba7768b31c482473b0c2d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:43,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:43,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:43,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:43,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:55:43,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3193ddb2777ba7768b31c482473b0c2d; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65735228, jitterRate=-0.02046877145767212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:43,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3193ddb2777ba7768b31c482473b0c2d: Running coprocessor pre-open hook at 1676015743221Writing region info on filesystem at 1676015743221Initializing all the Stores at 1676015743222 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015743222Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015743222Cleaning up temporary data from old regions at 1676015743293 (+71 ms)Cleaning up detritus from prior splits at 1676015743294 (+1 ms)Running coprocessor post-open hooks at 1676015743295 (+1 ms)Region opened successfully at 1676015743295 2023-02-10 07:55:43,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d., pid=103, masterSystemTime=1676015743218 2023-02-10 07:55:43,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:43,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:43,297 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-10 07:55:43,297 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-10 07:55:43,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:43,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:43,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:43,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 744b91c8a899e9abb35ea082e625e219, NAME => 'testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.', STARTKEY => '1', ENDKEY => '2'} 2023-02-10 07:55:43,298 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=3193ddb2777ba7768b31c482473b0c2d, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:43,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:43,298 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015743298"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015743298"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015743298"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015743298"}]},"ts":"1676015743298"} 2023-02-10 07:55:43,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:43,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:43,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:43,300 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:43,301 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-10 07:55:43,301 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1912): 3193ddb2777ba7768b31c482473b0c2d/family1 is initiating minor compaction (all files) 2023-02-10 07:55:43,301 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3193ddb2777ba7768b31c482473b0c2d/family1 in testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:43,301 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-32a1fdc2f81246ac907f976ad1ea613b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-7775dfe813fb4288a79d444dad06e8bf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-266bcb1710b047babae31ba9f5f50683, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-fc7cb9c260a54e7490f34395609725a4] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp, totalSize=21.6 K 2023-02-10 07:55:43,301 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-10 07:55:43,301 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1 2023-02-10 07:55:43,301 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1 2023-02-10 07:55:43,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-10 07:55:43,301 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HStore(1912): 3193ddb2777ba7768b31c482473b0c2d/family2 is initiating minor compaction (all files) 2023-02-10 07:55:43,302 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 3193ddb2777ba7768b31c482473b0c2d/family2 in testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:55:43,302 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-0b1791a83e884774b49d07239a14e0c9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-2c25151abe2d45349cf59bd324a1d49f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-c5e4e07154f24a7a95a1318704b50a59, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-3fa8681ae5d94986b0b34484534aeab8] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp, totalSize=20.4 K 2023-02-10 07:55:43,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 3193ddb2777ba7768b31c482473b0c2d, server=jenkins-hbase4.apache.org,36907,1676015618909 in 232 msec 2023-02-10 07:55:43,302 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 744b91c8a899e9abb35ea082e625e219 columnFamilyName family1 2023-02-10 07:55:43,302 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-32a1fdc2f81246ac907f976ad1ea613b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718195 2023-02-10 07:55:43,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3193ddb2777ba7768b31c482473b0c2d, ASSIGN in 389 msec 2023-02-10 07:55:43,303 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-7775dfe813fb4288a79d444dad06e8bf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:43,303 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-0b1791a83e884774b49d07239a14e0c9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718195 2023-02-10 07:55:43,307 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-266bcb1710b047babae31ba9f5f50683, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:43,307 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-2c25151abe2d45349cf59bd324a1d49f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:43,308 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-fc7cb9c260a54e7490f34395609725a4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723573 2023-02-10 07:55:43,309 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-c5e4e07154f24a7a95a1318704b50a59, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:43,310 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-3fa8681ae5d94986b0b34484534aeab8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723573 2023-02-10 07:55:43,320 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1123e3c0319a47068c017070f557fcda 2023-02-10 07:55:43,328 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1c1d3adae8f247069c82056b964bd27b 2023-02-10 07:55:43,340 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-5b6ae7c976314723827e4f82a3a27d3f 2023-02-10 07:55:43,344 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3193ddb2777ba7768b31c482473b0c2d#family1#compaction#114 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:43,355 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] throttle.PressureAwareThroughputController(145): 3193ddb2777ba7768b31c482473b0c2d#family2#compaction#115 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:43,359 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-6f45a8d7ff3d4813b45d3f9446022ee1 2023-02-10 07:55:43,363 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(310): Store=744b91c8a899e9abb35ea082e625e219/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:43,363 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:43,364 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2 2023-02-10 07:55:43,364 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2 2023-02-10 07:55:43,365 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 744b91c8a899e9abb35ea082e625e219 columnFamilyName family2 2023-02-10 07:55:43,371 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-13c047cdc7814849998094e93d74da3c 2023-02-10 07:55:43,376 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-420f88f654bb42cf828a7ba59c8d81f5 2023-02-10 07:55:43,380 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-b283ad650c844dfe8092e25b8a577ef4 2023-02-10 07:55:43,385 DEBUG [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-fc2e0af0eb924c2c9f2e7cba74673d9d 2023-02-10 07:55:43,385 INFO [StoreOpener-744b91c8a899e9abb35ea082e625e219-1] regionserver.HStore(310): Store=744b91c8a899e9abb35ea082e625e219/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:43,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:43,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:43,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:43,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:55:43,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 744b91c8a899e9abb35ea082e625e219; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67778386, jitterRate=0.00997665524482727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:43,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 744b91c8a899e9abb35ea082e625e219: Running coprocessor pre-open hook at 1676015743299Writing region info on filesystem at 1676015743299Initializing all the Stores at 1676015743299Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015743300 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015743300Cleaning up temporary data from old regions at 1676015743386 (+86 ms)Cleaning up detritus from prior splits at 1676015743387 (+1 ms)Running coprocessor post-open hooks at 1676015743389 (+2 ms)Region opened successfully at 1676015743389 2023-02-10 07:55:43,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219., pid=102, masterSystemTime=1676015743218 2023-02-10 07:55:43,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-10 07:55:43,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-10 07:55:43,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:43,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:43,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:43,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ff8b684a362b59eaec4d1812a47bc303, NAME => 'testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.', STARTKEY => '2', ENDKEY => ''} 2023-02-10 07:55:43,391 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=744b91c8a899e9abb35ea082e625e219, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:43,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:43,391 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015743391"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015743391"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015743391"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015743391"}]},"ts":"1676015743391"} 2023-02-10 07:55:43,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:43,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:43,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:43,393 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:43,393 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1 2023-02-10 07:55:43,393 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1 2023-02-10 07:55:43,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=99 2023-02-10 07:55:43,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 744b91c8a899e9abb35ea082e625e219, server=jenkins-hbase4.apache.org,36907,1676015618909 in 325 msec 2023-02-10 07:55:43,394 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff8b684a362b59eaec4d1812a47bc303 columnFamilyName family1 2023-02-10 07:55:43,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=744b91c8a899e9abb35ea082e625e219, ASSIGN in 482 msec 2023-02-10 07:55:43,400 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-5855fcb31ee84865a837469e36054852 2023-02-10 07:55:43,404 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-a3ff78ff236442e9a2c297e9dc2e2fef 2023-02-10 07:55:43,410 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d10dd022c4db4600b9109970843796d1 2023-02-10 07:55:43,420 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d338b24d69224058a6ff07d6021f4720 2023-02-10 07:55:43,420 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(310): Store=ff8b684a362b59eaec4d1812a47bc303/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:43,421 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:43,421 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2 2023-02-10 07:55:43,422 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2 2023-02-10 07:55:43,422 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff8b684a362b59eaec4d1812a47bc303 columnFamilyName family2 2023-02-10 07:55:43,430 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-6d30111acff54bf49981eca22dbdc6e5 2023-02-10 07:55:43,439 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b312503929a24983b678fe125e4a21ca 2023-02-10 07:55:43,445 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b3581b3afa09420ab9bfd09de18d3148 2023-02-10 07:55:43,451 DEBUG [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(539): loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-deb2ed4d7ca243a5b3b5c2b9a1adfe7a 2023-02-10 07:55:43,451 INFO [StoreOpener-ff8b684a362b59eaec4d1812a47bc303-1] regionserver.HStore(310): Store=ff8b684a362b59eaec4d1812a47bc303/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:43,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:43,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:43,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:43,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:55:43,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ff8b684a362b59eaec4d1812a47bc303; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64397409, jitterRate=-0.0404038280248642}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:43,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ff8b684a362b59eaec4d1812a47bc303: Running coprocessor pre-open hook at 1676015743392Writing region info on filesystem at 1676015743392Initializing all the Stores at 1676015743392Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015743392Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015743392Cleaning up temporary data from old regions at 1676015743453 (+61 ms)Cleaning up detritus from prior splits at 1676015743453Running coprocessor post-open hooks at 1676015743456 (+3 ms)Region opened successfully at 1676015743456 2023-02-10 07:55:43,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303., pid=101, masterSystemTime=1676015743218 2023-02-10 07:55:43,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-10 07:55:43,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-10 07:55:43,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:43,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:43,458 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=ff8b684a362b59eaec4d1812a47bc303, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:43,458 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676015743458"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015743458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015743458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015743458"}]},"ts":"1676015743458"} 2023-02-10 07:55:43,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-02-10 07:55:43,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure ff8b684a362b59eaec4d1812a47bc303, server=jenkins-hbase4.apache.org,36907,1676015618909 in 393 msec 2023-02-10 07:55:43,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-02-10 07:55:43,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=ff8b684a362b59eaec4d1812a47bc303, ASSIGN in 549 msec 2023-02-10 07:55:43,463 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015743463"}]},"ts":"1676015743463"} 2023-02-10 07:55:43,464 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-10 07:55:43,465 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-10 07:55:43,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 564 msec 2023-02-10 07:55:43,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-10 07:55:43,512 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-10 07:55:43,525 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:43,532 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:43,541 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:43,542 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:43,548 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-10 07:55:43,565 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-10 07:55:43,565 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:43,565 DEBUG [Listener at localhost/46793] zookeeper.ReadOnlyZKClient(139): Connect 0x0e13a0e8 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:55:43,570 DEBUG [Listener at localhost/46793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65d35e4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:55:43,570 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:43,570 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:43,570 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:44,435 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210dc124f410b5e4a429de63b24972bf499 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230210dc124f410b5e4a429de63b24972bf499 2023-02-10 07:55:44,437 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:44,440 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021011ffa2c54d0f49fcb89841f2868d9be4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021011ffa2c54d0f49fcb89841f2868d9be4 2023-02-10 07:55:44,441 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302102fc19f7cada84797a17a6496e7901552 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302102fc19f7cada84797a17a6496e7901552 2023-02-10 07:55:44,442 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:44,444 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:44,454 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:55:44,458 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48336, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:55:44,469 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:55:44,473 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:55:44,499 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210/family1/b810f253c689411081566cb7baed6ce9 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-10 07:55:44,500 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=32 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210/family1/b810f253c689411081566cb7baed6ce9}] 2023-02-10 07:55:44,502 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210/family1/17f744e333944f3aa5353aa00ca02c50 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-10 07:55:44,503 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210/family1/17f744e333944f3aa5353aa00ca02c50}] 2023-02-10 07:55:44,504 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210/family1/6999204a9bf14fdbb667c8c1b70a17bd first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-10 07:55:44,507 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210/family1/6999204a9bf14fdbb667c8c1b70a17bd}] 2023-02-10 07:55:44,508 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210/family1/b810f253c689411081566cb7baed6ce9 for inclusion in 3193ddb2777ba7768b31c482473b0c2d/family1 2023-02-10 07:55:44,509 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210/family1/17f744e333944f3aa5353aa00ca02c50 for inclusion in ff8b684a362b59eaec4d1812a47bc303/family1 2023-02-10 07:55:44,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210/family1/6999204a9bf14fdbb667c8c1b70a17bd for inclusion in 744b91c8a899e9abb35ea082e625e219/family1 2023-02-10 07:55:44,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-10 07:55:44,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-10 07:55:44,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last=1 2023-02-10 07:55:44,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-10 07:55:44,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:44,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:44,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-10 07:55:44,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-10 07:55:44,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:44,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210/family1/17f744e333944f3aa5353aa00ca02c50 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__av8o7pjk6ophgvo6dobs8lm20dph7prjk9cq4d46iefg6a3al5hhi9831ob32h5i/family1/17f744e333944f3aa5353aa00ca02c50 2023-02-10 07:55:44,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210/family1/b810f253c689411081566cb7baed6ce9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__hqkhnvvom9e5ge0k8dpgfpg9espu19266all0m5lm2qqa0971n0e2dqonc0fmko8/family1/b810f253c689411081566cb7baed6ce9 2023-02-10 07:55:44,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210/family1/6999204a9bf14fdbb667c8c1b70a17bd to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__rlob0a1st7fj9hslnsf67j159odkevvjrnl77n5tkoeisara2nq242f1iv3fkp1c/family1/6999204a9bf14fdbb667c8c1b70a17bd 2023-02-10 07:55:44,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__av8o7pjk6ophgvo6dobs8lm20dph7prjk9cq4d46iefg6a3al5hhi9831ob32h5i/family1/17f744e333944f3aa5353aa00ca02c50 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/8407e0f867634fa5817848bb737e67ab_SeqId_34_ 2023-02-10 07:55:44,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__hqkhnvvom9e5ge0k8dpgfpg9espu19266all0m5lm2qqa0971n0e2dqonc0fmko8/family1/b810f253c689411081566cb7baed6ce9 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/c01ce9fc4b334e35aa7275c8ac4015c9_SeqId_34_ 2023-02-10 07:55:44,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__rlob0a1st7fj9hslnsf67j159odkevvjrnl77n5tkoeisara2nq242f1iv3fkp1c/family1/6999204a9bf14fdbb667c8c1b70a17bd as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/40b03854e54841d5950ad84829b36aee_SeqId_34_ 2023-02-10 07:55:44,519 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__av8o7pjk6ophgvo6dobs8lm20dph7prjk9cq4d46iefg6a3al5hhi9831ob32h5i/family1/17f744e333944f3aa5353aa00ca02c50 into ff8b684a362b59eaec4d1812a47bc303/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/8407e0f867634fa5817848bb737e67ab_SeqId_34_ - updating store file list. 2023-02-10 07:55:44,519 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__hqkhnvvom9e5ge0k8dpgfpg9espu19266all0m5lm2qqa0971n0e2dqonc0fmko8/family1/b810f253c689411081566cb7baed6ce9 into 3193ddb2777ba7768b31c482473b0c2d/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/c01ce9fc4b334e35aa7275c8ac4015c9_SeqId_34_ - updating store file list. 2023-02-10 07:55:44,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__rlob0a1st7fj9hslnsf67j159odkevvjrnl77n5tkoeisara2nq242f1iv3fkp1c/family1/6999204a9bf14fdbb667c8c1b70a17bd into 744b91c8a899e9abb35ea082e625e219/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/40b03854e54841d5950ad84829b36aee_SeqId_34_ - updating store file list. 2023-02-10 07:55:44,524 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/8407e0f867634fa5817848bb737e67ab_SeqId_34_ into ff8b684a362b59eaec4d1812a47bc303/family1 2023-02-10 07:55:44,524 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__av8o7pjk6ophgvo6dobs8lm20dph7prjk9cq4d46iefg6a3al5hhi9831ob32h5i/family1/17f744e333944f3aa5353aa00ca02c50 into ff8b684a362b59eaec4d1812a47bc303/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/8407e0f867634fa5817848bb737e67ab_SeqId_34_) 2023-02-10 07:55:44,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/c01ce9fc4b334e35aa7275c8ac4015c9_SeqId_34_ into 3193ddb2777ba7768b31c482473b0c2d/family1 2023-02-10 07:55:44,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__hqkhnvvom9e5ge0k8dpgfpg9espu19266all0m5lm2qqa0971n0e2dqonc0fmko8/family1/b810f253c689411081566cb7baed6ce9 into 3193ddb2777ba7768b31c482473b0c2d/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/c01ce9fc4b334e35aa7275c8ac4015c9_SeqId_34_) 2023-02-10 07:55:44,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__av8o7pjk6ophgvo6dobs8lm20dph7prjk9cq4d46iefg6a3al5hhi9831ob32h5i/family1/17f744e333944f3aa5353aa00ca02c50 2023-02-10 07:55:44,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__hqkhnvvom9e5ge0k8dpgfpg9espu19266all0m5lm2qqa0971n0e2dqonc0fmko8/family1/b810f253c689411081566cb7baed6ce9 2023-02-10 07:55:44,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:44,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/40b03854e54841d5950ad84829b36aee_SeqId_34_ into 744b91c8a899e9abb35ea082e625e219/family1 2023-02-10 07:55:44,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__rlob0a1st7fj9hslnsf67j159odkevvjrnl77n5tkoeisara2nq242f1iv3fkp1c/family1/6999204a9bf14fdbb667c8c1b70a17bd into 744b91c8a899e9abb35ea082e625e219/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/40b03854e54841d5950ad84829b36aee_SeqId_34_) 2023-02-10 07:55:44,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testCompactionWithHFileLink__rlob0a1st7fj9hslnsf67j159odkevvjrnl77n5tkoeisara2nq242f1iv3fkp1c/family1/6999204a9bf14fdbb667c8c1b70a17bd 2023-02-10 07:55:44,527 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:44,528 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:44,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-10 07:55:44,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(1912): ff8b684a362b59eaec4d1812a47bc303/family1 is initiating minor compaction (all files) 2023-02-10 07:55:44,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@28f320d3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-10 07:55:44,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:44,530 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302106a92395f78aa4ce7a6cb6e16408100f4 2023-02-10 07:55:44,530 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:44,531 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:44,531 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021083a8429443774677ba3e0b03c6dd63d4 2023-02-10 07:55:44,532 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230210e64308dbf50e45bd97c8d0db66fabfa8 2023-02-10 07:55:44,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-10 07:55:44,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 744b91c8a899e9abb35ea082e625e219/family1 is initiating minor compaction (all files) 2023-02-10 07:55:44,533 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302107de0bf9a731347f2a3b27e55cf12c201 2023-02-10 07:55:44,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3f8b323a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-10 07:55:44,534 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230210adc1025bab9e4be8aacf48dc54818cce 2023-02-10 07:55:44,535 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230210 table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:44,536 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230210fca1a097ad824466a0bbc40a90b568f6 2023-02-10 07:55:44,536 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-10 07:55:44,536 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230210' 2023-02-10 07:55:44,536 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:44,536 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230210deee30d20a054277b0e52ceff4ed1318 2023-02-10 07:55:44,536 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:44,538 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230210e14e616b92fc4af9ad0c62dcab389d02 2023-02-10 07:55:44,538 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-10 07:55:44,538 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230210' 2023-02-10 07:55:44,538 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302105ce8a75dc3c84c05b7ceab468abfdac1 2023-02-10 07:55:44,538 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:44,539 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302106850b2c4a26a4998b7a4500f18b00a1d 2023-02-10 07:55:44,540 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230210acdb83fb5b1e4fb5a2ec28fe8d9cc96d 2023-02-10 07:55:44,541 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230210d451e000841243c892c0512d72adfb7a 2023-02-10 07:55:44,541 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-10 07:55:44,541 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230210' 2023-02-10 07:55:44,541 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230210 for table='testCompactionWithHFileLink' and column='family1' 2023-02-10 07:55:44,541 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-10 07:55:44,544 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:44,548 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:44,552 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:44,553 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:44,560 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:44,561 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:44,575 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family1/dc7f5e9c8111436aa9bd0b21f10f3796 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/dc7f5e9c8111436aa9bd0b21f10f3796 2023-02-10 07:55:44,579 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-10 07:55:44,580 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/.tmp/family2/8c58ace3c003456f865f697dcfced364 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/8c58ace3c003456f865f697dcfced364 2023-02-10 07:55:44,580 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 3193ddb2777ba7768b31c482473b0c2d/family1 of 3193ddb2777ba7768b31c482473b0c2d into dc7f5e9c8111436aa9bd0b21f10f3796(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:44,580 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:44,580 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d., storeName=3193ddb2777ba7768b31c482473b0c2d/family1, priority=12, startTime=1676015743296; duration=1sec 2023-02-10 07:55:44,580 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-02-10 07:55:44,580 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of ff8b684a362b59eaec4d1812a47bc303/family1 in testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:44,580 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-a3ff78ff236442e9a2c297e9dc2e2fef, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d338b24d69224058a6ff07d6021f4720, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-5855fcb31ee84865a837469e36054852, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d10dd022c4db4600b9109970843796d1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/8407e0f867634fa5817848bb737e67ab_SeqId_34_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp, totalSize=28.9 K 2023-02-10 07:55:44,581 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-a3ff78ff236442e9a2c297e9dc2e2fef, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718197 2023-02-10 07:55:44,581 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 235) - Thread LEAK? -, OpenFileDescriptor=762 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=87 (was 135), ProcessCount=168 (was 168), AvailableMemoryMB=3164 (was 3300) 2023-02-10 07:55:44,585 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d338b24d69224058a6ff07d6021f4720, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:44,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-32a1fdc2f81246ac907f976ad1ea613b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-7775dfe813fb4288a79d444dad06e8bf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-266bcb1710b047babae31ba9f5f50683, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-fc7cb9c260a54e7490f34395609725a4] to archive 2023-02-10 07:55:44,586 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-5855fcb31ee84865a837469e36054852, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:44,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:44,587 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d10dd022c4db4600b9109970843796d1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723574 2023-02-10 07:55:44,587 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 8407e0f867634fa5817848bb737e67ab_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676015718197 2023-02-10 07:55:44,589 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 3193ddb2777ba7768b31c482473b0c2d/family2 of 3193ddb2777ba7768b31c482473b0c2d into 8c58ace3c003456f865f697dcfced364(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:44,589 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3193ddb2777ba7768b31c482473b0c2d: 2023-02-10 07:55:44,589 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d., storeName=3193ddb2777ba7768b31c482473b0c2d/family2, priority=12, startTime=1676015743297; duration=1sec 2023-02-10 07:55:44,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-32a1fdc2f81246ac907f976ad1ea613b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-32a1fdc2f81246ac907f976ad1ea613b 2023-02-10 07:55:44,589 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-10 07:55:44,589 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 744b91c8a899e9abb35ea082e625e219/family1 in testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:44,589 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-5b6ae7c976314723827e4f82a3a27d3f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-6f45a8d7ff3d4813b45d3f9446022ee1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1123e3c0319a47068c017070f557fcda, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1c1d3adae8f247069c82056b964bd27b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/40b03854e54841d5950ad84829b36aee_SeqId_34_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp, totalSize=28.9 K 2023-02-10 07:55:44,590 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-5b6ae7c976314723827e4f82a3a27d3f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718196 2023-02-10 07:55:44,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-7775dfe813fb4288a79d444dad06e8bf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-7775dfe813fb4288a79d444dad06e8bf 2023-02-10 07:55:44,591 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-6f45a8d7ff3d4813b45d3f9446022ee1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:44,592 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1123e3c0319a47068c017070f557fcda, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:44,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-266bcb1710b047babae31ba9f5f50683 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-266bcb1710b047babae31ba9f5f50683 2023-02-10 07:55:44,592 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1c1d3adae8f247069c82056b964bd27b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723574 2023-02-10 07:55:44,593 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting 40b03854e54841d5950ad84829b36aee_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676015718196 2023-02-10 07:55:44,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-fc7cb9c260a54e7490f34395609725a4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family1/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-fc7cb9c260a54e7490f34395609725a4 2023-02-10 07:55:44,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-0b1791a83e884774b49d07239a14e0c9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-2c25151abe2d45349cf59bd324a1d49f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-c5e4e07154f24a7a95a1318704b50a59, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-3fa8681ae5d94986b0b34484534aeab8] to archive 2023-02-10 07:55:44,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:44,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-0b1791a83e884774b49d07239a14e0c9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-0b1791a83e884774b49d07239a14e0c9 2023-02-10 07:55:44,598 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=283, OpenFileDescriptor=755, MaxFileDescriptor=60000, SystemLoadAverage=87, ProcessCount=168, AvailableMemoryMB=3163 2023-02-10 07:55:44,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-2c25151abe2d45349cf59bd324a1d49f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-2c25151abe2d45349cf59bd324a1d49f 2023-02-10 07:55:44,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-c5e4e07154f24a7a95a1318704b50a59 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-c5e4e07154f24a7a95a1318704b50a59 2023-02-10 07:55:44,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$15(2997): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-02-10 07:55:44,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-10 07:55:44,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-3fa8681ae5d94986b0b34484534aeab8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/family2/testCompactionWithHFileLink=3193ddb2777ba7768b31c482473b0c2d-3fa8681ae5d94986b0b34484534aeab8 2023-02-10 07:55:44,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-10 07:55:44,616 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-10 07:55:44,617 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] throttle.PressureAwareThroughputController(145): 744b91c8a899e9abb35ea082e625e219#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:44,619 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff8b684a362b59eaec4d1812a47bc303#family1#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:44,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 14 msec 2023-02-10 07:55:44,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-10 07:55:44,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-10 07:55:44,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-10 07:55:44,719 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:55:44,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-10 07:55:44,720 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:55:44,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967 empty. 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b empty. 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b empty. 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:44,722 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:44,722 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-10 07:55:44,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-10 07:55:45,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-10 07:55:45,129 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-10 07:55:45,131 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7b3e442243ba917643e7f579e42fd52b, NAME => 'ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:55:45,131 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9dc8a10e21dc7c3a80e8fe5db00b967, NAME => 'ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:55:45,131 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => ad05c8b2ddd0721f147299fc051d2e1b, NAME => 'ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:55:45,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-10 07:55:45,436 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family1/cfad4b0a9b35433c89bfebc19ced3bfa as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/cfad4b0a9b35433c89bfebc19ced3bfa 2023-02-10 07:55:45,440 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in ff8b684a362b59eaec4d1812a47bc303/family1 of ff8b684a362b59eaec4d1812a47bc303 into cfad4b0a9b35433c89bfebc19ced3bfa(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:55:45,440 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:45,440 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676015744528; duration=0sec 2023-02-10 07:55:45,440 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-10 07:55:45,440 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-10 07:55:45,442 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-10 07:55:45,442 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1912): 744b91c8a899e9abb35ea082e625e219/family2 is initiating minor compaction (all files) 2023-02-10 07:55:45,442 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 744b91c8a899e9abb35ea082e625e219/family2 in testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:55:45,442 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-13c047cdc7814849998094e93d74da3c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-fc2e0af0eb924c2c9f2e7cba74673d9d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-420f88f654bb42cf828a7ba59c8d81f5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-b283ad650c844dfe8092e25b8a577ef4] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp, totalSize=20.4 K 2023-02-10 07:55:45,443 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-13c047cdc7814849998094e93d74da3c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718196 2023-02-10 07:55:45,443 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-fc2e0af0eb924c2c9f2e7cba74673d9d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:45,443 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-420f88f654bb42cf828a7ba59c8d81f5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:45,444 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-b283ad650c844dfe8092e25b8a577ef4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723574 2023-02-10 07:55:45,454 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 744b91c8a899e9abb35ea082e625e219#family2#compaction#118 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:45,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-a3ff78ff236442e9a2c297e9dc2e2fef, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d338b24d69224058a6ff07d6021f4720, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-5855fcb31ee84865a837469e36054852, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d10dd022c4db4600b9109970843796d1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/8407e0f867634fa5817848bb737e67ab_SeqId_34_] to archive 2023-02-10 07:55:45,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:45,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-a3ff78ff236442e9a2c297e9dc2e2fef to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-a3ff78ff236442e9a2c297e9dc2e2fef 2023-02-10 07:55:45,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d338b24d69224058a6ff07d6021f4720 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d338b24d69224058a6ff07d6021f4720 2023-02-10 07:55:45,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-5855fcb31ee84865a837469e36054852 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-5855fcb31ee84865a837469e36054852 2023-02-10 07:55:45,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d10dd022c4db4600b9109970843796d1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-d10dd022c4db4600b9109970843796d1 2023-02-10 07:55:45,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/8407e0f867634fa5817848bb737e67ab_SeqId_34_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family1/8407e0f867634fa5817848bb737e67ab_SeqId_34_ 2023-02-10 07:55:45,498 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:55:45,536 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:45,536 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing ad05c8b2ddd0721f147299fc051d2e1b, disabling compactions & flushes 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing c9dc8a10e21dc7c3a80e8fe5db00b967, disabling compactions & flushes 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 7b3e442243ba917643e7f579e42fd52b, disabling compactions & flushes 2023-02-10 07:55:45,537 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:45,537 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. after waiting 0 ms 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:45,537 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:45,537 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for c9dc8a10e21dc7c3a80e8fe5db00b967: Waiting for close lock at 1676015745537Disabling compacts and flushes for region at 1676015745537Disabling writes for close at 1676015745537Writing region close event to WAL at 1676015745537Closed at 1676015745537 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. after waiting 0 ms 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. after waiting 0 ms 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:45,537 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:45,537 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 7b3e442243ba917643e7f579e42fd52b: Waiting for close lock at 1676015745537Disabling compacts and flushes for region at 1676015745537Disabling writes for close at 1676015745537Writing region close event to WAL at 1676015745537Closed at 1676015745537 2023-02-10 07:55:45,537 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for ad05c8b2ddd0721f147299fc051d2e1b: Waiting for close lock at 1676015745537Disabling compacts and flushes for region at 1676015745537Disabling writes for close at 1676015745537Writing region close event to WAL at 1676015745537Closed at 1676015745537 2023-02-10 07:55:45,539 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:55:45,540 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676015745540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015745540"}]},"ts":"1676015745540"} 2023-02-10 07:55:45,540 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676015745540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015745540"}]},"ts":"1676015745540"} 2023-02-10 07:55:45,540 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676015745540"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015745540"}]},"ts":"1676015745540"} 2023-02-10 07:55:45,542 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-10 07:55:45,542 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:55:45,543 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015745543"}]},"ts":"1676015745543"} 2023-02-10 07:55:45,543 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-10 07:55:45,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c9dc8a10e21dc7c3a80e8fe5db00b967, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b3e442243ba917643e7f579e42fd52b, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ad05c8b2ddd0721f147299fc051d2e1b, ASSIGN}] 2023-02-10 07:55:45,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c9dc8a10e21dc7c3a80e8fe5db00b967, ASSIGN 2023-02-10 07:55:45,549 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ad05c8b2ddd0721f147299fc051d2e1b, ASSIGN 2023-02-10 07:55:45,549 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b3e442243ba917643e7f579e42fd52b, ASSIGN 2023-02-10 07:55:45,549 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c9dc8a10e21dc7c3a80e8fe5db00b967, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:55:45,549 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ad05c8b2ddd0721f147299fc051d2e1b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:55:45,549 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b3e442243ba917643e7f579e42fd52b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:55:45,702 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c9dc8a10e21dc7c3a80e8fe5db00b967, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:45,702 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7b3e442243ba917643e7f579e42fd52b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:45,702 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=ad05c8b2ddd0721f147299fc051d2e1b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:45,702 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676015745702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015745702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015745702"}]},"ts":"1676015745702"} 2023-02-10 07:55:45,702 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676015745702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015745702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015745702"}]},"ts":"1676015745702"} 2023-02-10 07:55:45,702 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676015745702"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015745702"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015745702"}]},"ts":"1676015745702"} 2023-02-10 07:55:45,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c9dc8a10e21dc7c3a80e8fe5db00b967, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:45,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 7b3e442243ba917643e7f579e42fd52b, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:45,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure ad05c8b2ddd0721f147299fc051d2e1b, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:55:45,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-10 07:55:45,835 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family1/7d452edd3cb54c789efd8ff9ff2573bc as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/7d452edd3cb54c789efd8ff9ff2573bc 2023-02-10 07:55:45,838 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 744b91c8a899e9abb35ea082e625e219/family1 of 744b91c8a899e9abb35ea082e625e219 into 7d452edd3cb54c789efd8ff9ff2573bc(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:45,838 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:45,838 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676015744532; duration=1sec 2023-02-10 07:55:45,838 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-10 07:55:45,839 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-10 07:55:45,840 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-10 07:55:45,840 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HStore(1912): ff8b684a362b59eaec4d1812a47bc303/family2 is initiating minor compaction (all files) 2023-02-10 07:55:45,840 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegion(2258): Starting compaction of ff8b684a362b59eaec4d1812a47bc303/family2 in testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:55:45,841 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-6d30111acff54bf49981eca22dbdc6e5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b3581b3afa09420ab9bfd09de18d3148, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-deb2ed4d7ca243a5b3b5c2b9a1adfe7a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b312503929a24983b678fe125e4a21ca] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp, totalSize=20.4 K 2023-02-10 07:55:45,841 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-6d30111acff54bf49981eca22dbdc6e5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015718197 2023-02-10 07:55:45,841 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b3581b3afa09420ab9bfd09de18d3148, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015719977 2023-02-10 07:55:45,842 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-deb2ed4d7ca243a5b3b5c2b9a1adfe7a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015721767 2023-02-10 07:55:45,842 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b312503929a24983b678fe125e4a21ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015723574 2023-02-10 07:55:45,852 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] throttle.PressureAwareThroughputController(145): ff8b684a362b59eaec4d1812a47bc303#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:45,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:45,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c9dc8a10e21dc7c3a80e8fe5db00b967, NAME => 'ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967.', STARTKEY => '', ENDKEY => '1'} 2023-02-10 07:55:45,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:45,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:45,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:45,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:45,858 INFO [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:45,859 DEBUG [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1 2023-02-10 07:55:45,859 DEBUG [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1 2023-02-10 07:55:45,859 INFO [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9dc8a10e21dc7c3a80e8fe5db00b967 columnFamilyName family1 2023-02-10 07:55:45,861 INFO [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] regionserver.HStore(310): Store=c9dc8a10e21dc7c3a80e8fe5db00b967/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:45,861 INFO [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:45,862 DEBUG [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2 2023-02-10 07:55:45,862 DEBUG [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2 2023-02-10 07:55:45,862 INFO [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9dc8a10e21dc7c3a80e8fe5db00b967 columnFamilyName family2 2023-02-10 07:55:45,863 INFO [StoreOpener-c9dc8a10e21dc7c3a80e8fe5db00b967-1] regionserver.HStore(310): Store=c9dc8a10e21dc7c3a80e8fe5db00b967/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:45,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:45,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:45,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:45,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:55:45,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:55:45,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c9dc8a10e21dc7c3a80e8fe5db00b967; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73530880, jitterRate=0.09569549560546875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:45,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c9dc8a10e21dc7c3a80e8fe5db00b967: Running coprocessor pre-open hook at 1676015745857Writing region info on filesystem at 1676015745857Initializing all the Stores at 1676015745857Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015745858 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015745858Cleaning up temporary data from old regions at 1676015745865 (+7 ms)Cleaning up detritus from prior splits at 1676015745865Running coprocessor post-open hooks at 1676015745868 (+3 ms)Region opened successfully at 1676015745868 2023-02-10 07:55:45,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967., pid=109, masterSystemTime=1676015745855 2023-02-10 07:55:45,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:45,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:45,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:45,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b3e442243ba917643e7f579e42fd52b, NAME => 'ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b.', STARTKEY => '1', ENDKEY => '2'} 2023-02-10 07:55:45,870 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c9dc8a10e21dc7c3a80e8fe5db00b967, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:45,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:45,870 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676015745870"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015745870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015745870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015745870"}]},"ts":"1676015745870"} 2023-02-10 07:55:45,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:45,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:45,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:45,871 INFO [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:45,872 DEBUG [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1 2023-02-10 07:55:45,872 DEBUG [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1 2023-02-10 07:55:45,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-02-10 07:55:45,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c9dc8a10e21dc7c3a80e8fe5db00b967, server=jenkins-hbase4.apache.org,36907,1676015618909 in 168 msec 2023-02-10 07:55:45,872 INFO [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b3e442243ba917643e7f579e42fd52b columnFamilyName family1 2023-02-10 07:55:45,873 INFO [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] regionserver.HStore(310): Store=7b3e442243ba917643e7f579e42fd52b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:45,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c9dc8a10e21dc7c3a80e8fe5db00b967, ASSIGN in 326 msec 2023-02-10 07:55:45,874 INFO [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:45,875 DEBUG [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2 2023-02-10 07:55:45,875 DEBUG [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2 2023-02-10 07:55:45,875 INFO [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b3e442243ba917643e7f579e42fd52b columnFamilyName family2 2023-02-10 07:55:45,875 INFO [StoreOpener-7b3e442243ba917643e7f579e42fd52b-1] regionserver.HStore(310): Store=7b3e442243ba917643e7f579e42fd52b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:45,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:45,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:45,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:45,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:55:45,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:55:45,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7b3e442243ba917643e7f579e42fd52b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66965444, jitterRate=-0.002137124538421631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:45,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7b3e442243ba917643e7f579e42fd52b: Running coprocessor pre-open hook at 1676015745870Writing region info on filesystem at 1676015745870Initializing all the Stores at 1676015745871 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015745871Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015745871Cleaning up temporary data from old regions at 1676015745877 (+6 ms)Cleaning up detritus from prior splits at 1676015745877Running coprocessor post-open hooks at 1676015745880 (+3 ms)Region opened successfully at 1676015745880 2023-02-10 07:55:45,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b., pid=110, masterSystemTime=1676015745855 2023-02-10 07:55:45,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:45,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:45,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:45,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ad05c8b2ddd0721f147299fc051d2e1b, NAME => 'ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b.', STARTKEY => '2', ENDKEY => ''} 2023-02-10 07:55:45,882 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7b3e442243ba917643e7f579e42fd52b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:45,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:45,882 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676015745882"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015745882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015745882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015745882"}]},"ts":"1676015745882"} 2023-02-10 07:55:45,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:55:45,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:45,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:45,883 INFO [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:45,884 DEBUG [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1 2023-02-10 07:55:45,884 DEBUG [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1 2023-02-10 07:55:45,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=107 2023-02-10 07:55:45,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 7b3e442243ba917643e7f579e42fd52b, server=jenkins-hbase4.apache.org,36907,1676015618909 in 179 msec 2023-02-10 07:55:45,884 INFO [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad05c8b2ddd0721f147299fc051d2e1b columnFamilyName family1 2023-02-10 07:55:45,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b3e442243ba917643e7f579e42fd52b, ASSIGN in 337 msec 2023-02-10 07:55:45,885 INFO [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] regionserver.HStore(310): Store=ad05c8b2ddd0721f147299fc051d2e1b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:45,885 INFO [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:45,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-5b6ae7c976314723827e4f82a3a27d3f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-6f45a8d7ff3d4813b45d3f9446022ee1, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1123e3c0319a47068c017070f557fcda, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1c1d3adae8f247069c82056b964bd27b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/40b03854e54841d5950ad84829b36aee_SeqId_34_] to archive 2023-02-10 07:55:45,886 DEBUG [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2 2023-02-10 07:55:45,886 DEBUG [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2 2023-02-10 07:55:45,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:45,887 INFO [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad05c8b2ddd0721f147299fc051d2e1b columnFamilyName family2 2023-02-10 07:55:45,887 INFO [StoreOpener-ad05c8b2ddd0721f147299fc051d2e1b-1] regionserver.HStore(310): Store=ad05c8b2ddd0721f147299fc051d2e1b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:55:45,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-5b6ae7c976314723827e4f82a3a27d3f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-5b6ae7c976314723827e4f82a3a27d3f 2023-02-10 07:55:45,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:45,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:45,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-6f45a8d7ff3d4813b45d3f9446022ee1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-6f45a8d7ff3d4813b45d3f9446022ee1 2023-02-10 07:55:45,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:55:45,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1123e3c0319a47068c017070f557fcda to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1123e3c0319a47068c017070f557fcda 2023-02-10 07:55:45,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:55:45,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1c1d3adae8f247069c82056b964bd27b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-1c1d3adae8f247069c82056b964bd27b 2023-02-10 07:55:45,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/40b03854e54841d5950ad84829b36aee_SeqId_34_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family1/40b03854e54841d5950ad84829b36aee_SeqId_34_ 2023-02-10 07:55:45,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:55:45,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ad05c8b2ddd0721f147299fc051d2e1b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65297459, jitterRate=-0.026992037892341614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:55:45,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ad05c8b2ddd0721f147299fc051d2e1b: Running coprocessor pre-open hook at 1676015745882Writing region info on filesystem at 1676015745882Initializing all the Stores at 1676015745883 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015745883Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015745883Cleaning up temporary data from old regions at 1676015745889 (+6 ms)Cleaning up detritus from prior splits at 1676015745889Running coprocessor post-open hooks at 1676015745893 (+4 ms)Region opened successfully at 1676015745893 2023-02-10 07:55:45,893 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b., pid=111, masterSystemTime=1676015745855 2023-02-10 07:55:45,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:45,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:45,895 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=ad05c8b2ddd0721f147299fc051d2e1b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:45,895 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676015745895"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015745895"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015745895"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015745895"}]},"ts":"1676015745895"} 2023-02-10 07:55:45,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-02-10 07:55:45,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure ad05c8b2ddd0721f147299fc051d2e1b, server=jenkins-hbase4.apache.org,36907,1676015618909 in 192 msec 2023-02-10 07:55:45,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-02-10 07:55:45,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=ad05c8b2ddd0721f147299fc051d2e1b, ASSIGN in 350 msec 2023-02-10 07:55:45,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:55:45,898 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015745898"}]},"ts":"1676015745898"} 2023-02-10 07:55:45,899 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-10 07:55:45,902 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:55:45,903 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1850 sec 2023-02-10 07:55:46,432 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-10 07:55:46,669 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/.tmp/family2/759cc767417e4f20ac964447ec0ffc78 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/759cc767417e4f20ac964447ec0ffc78 2023-02-10 07:55:46,673 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 744b91c8a899e9abb35ea082e625e219/family2 of 744b91c8a899e9abb35ea082e625e219 into 759cc767417e4f20ac964447ec0ffc78(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:46,673 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 744b91c8a899e9abb35ea082e625e219: 2023-02-10 07:55:46,673 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219., storeName=744b91c8a899e9abb35ea082e625e219/family2, priority=12, startTime=1676015743390; duration=1sec 2023-02-10 07:55:46,673 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-10 07:55:46,674 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-10 07:55:46,674 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-10 07:55:46,674 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-10 07:55:46,674 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. because compaction request was cancelled 2023-02-10 07:55:46,674 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-10 07:55:46,674 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-10 07:55:46,674 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-10 07:55:46,674 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. because compaction request was cancelled 2023-02-10 07:55:46,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-13c047cdc7814849998094e93d74da3c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-fc2e0af0eb924c2c9f2e7cba74673d9d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-420f88f654bb42cf828a7ba59c8d81f5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-b283ad650c844dfe8092e25b8a577ef4] to archive 2023-02-10 07:55:46,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:46,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-13c047cdc7814849998094e93d74da3c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-13c047cdc7814849998094e93d74da3c 2023-02-10 07:55:46,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-fc2e0af0eb924c2c9f2e7cba74673d9d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-fc2e0af0eb924c2c9f2e7cba74673d9d 2023-02-10 07:55:46,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-420f88f654bb42cf828a7ba59c8d81f5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-420f88f654bb42cf828a7ba59c8d81f5 2023-02-10 07:55:46,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-b283ad650c844dfe8092e25b8a577ef4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/family2/testCompactionWithHFileLink=744b91c8a899e9abb35ea082e625e219-b283ad650c844dfe8092e25b8a577ef4 2023-02-10 07:55:46,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-10 07:55:46,825 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-10 07:55:46,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:46,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:46,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:46,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:46,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-10 07:55:46,835 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-10 07:55:46,835 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:46,835 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-10 07:55:46,835 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-10 07:55:46,835 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:46,835 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:46,837 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:46,837 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:46,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:46,837 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:46,837 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:46,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:46,838 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-10 07:55:46,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-10 07:55:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-10 07:55:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-10 07:55:46,839 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:46,839 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:46,839 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:46,839 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. started... 2023-02-10 07:55:46,839 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. started... 2023-02-10 07:55:46,839 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:46,839 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:46,840 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b3e442243ba917643e7f579e42fd52b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:55:46,841 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c9dc8a10e21dc7c3a80e8fe5db00b967 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:55:46,840 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. started... 2023-02-10 07:55:46,841 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ad05c8b2ddd0721f147299fc051d2e1b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:55:47,069 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/.tmp/family2/005d6078b0dc44619678583496326867 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/005d6078b0dc44619678583496326867 2023-02-10 07:55:47,073 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in ff8b684a362b59eaec4d1812a47bc303/family2 of ff8b684a362b59eaec4d1812a47bc303 into 005d6078b0dc44619678583496326867(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:47,073 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for ff8b684a362b59eaec4d1812a47bc303: 2023-02-10 07:55:47,073 INFO [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303., storeName=ff8b684a362b59eaec4d1812a47bc303/family2, priority=12, startTime=1676015743457; duration=1sec 2023-02-10 07:55:47,073 DEBUG [RS:0;jenkins-hbase4:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:55:47,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-6d30111acff54bf49981eca22dbdc6e5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b3581b3afa09420ab9bfd09de18d3148, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-deb2ed4d7ca243a5b3b5c2b9a1adfe7a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b312503929a24983b678fe125e4a21ca] to archive 2023-02-10 07:55:47,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:47,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-6d30111acff54bf49981eca22dbdc6e5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-6d30111acff54bf49981eca22dbdc6e5 2023-02-10 07:55:47,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b3581b3afa09420ab9bfd09de18d3148 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b3581b3afa09420ab9bfd09de18d3148 2023-02-10 07:55:47,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-deb2ed4d7ca243a5b3b5c2b9a1adfe7a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-deb2ed4d7ca243a5b3b5c2b9a1adfe7a 2023-02-10 07:55:47,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b312503929a24983b678fe125e4a21ca to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/family2/testCompactionWithHFileLink=ff8b684a362b59eaec4d1812a47bc303-b312503929a24983b678fe125e4a21ca 2023-02-10 07:55:47,252 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302105f62861d17be4954a6f54f017a18f333 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302105f62861d17be4954a6f54f017a18f333 2023-02-10 07:55:47,252 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302107da70ab20c3f4b6e95fac08ed527d5d5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302107da70ab20c3f4b6e95fac08ed527d5d5 2023-02-10 07:55:47,252 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302106bb00f07f1f8469084a241effa3f7706 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302106bb00f07f1f8469084a241effa3f7706 2023-02-10 07:55:47,260 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/5049804aed5c471db9aaadd070b5c685 2023-02-10 07:55:47,659 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/f95ea2d11b014b6387477663c12497f4 2023-02-10 07:55:47,660 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/96bfaefd62bc46d7869db53b846d7131 2023-02-10 07:55:47,678 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021019601729190a4a8b8954d3bb4f5bae57 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021019601729190a4a8b8954d3bb4f5bae57 2023-02-10 07:55:47,679 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210fb16e7c3a9104c49be5ee45409017836 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230210fb16e7c3a9104c49be5ee45409017836 2023-02-10 07:55:47,683 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/5d30834095ca479089e8614783b36529 2023-02-10 07:55:47,686 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/96bfaefd62bc46d7869db53b846d7131 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/96bfaefd62bc46d7869db53b846d7131 2023-02-10 07:55:47,690 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/96bfaefd62bc46d7869db53b846d7131, entries=4, sequenceid=5, filesize=5.4 K 2023-02-10 07:55:47,690 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/5d30834095ca479089e8614783b36529 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/5d30834095ca479089e8614783b36529 2023-02-10 07:55:47,693 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/5d30834095ca479089e8614783b36529, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:55:47,694 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c9dc8a10e21dc7c3a80e8fe5db00b967 in 854ms, sequenceid=5, compaction requested=false 2023-02-10 07:55:47,695 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c9dc8a10e21dc7c3a80e8fe5db00b967: 2023-02-10 07:55:47,695 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:47,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:48,077 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210f10aa4de2af94eecb263d646bc755cff to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230210f10aa4de2af94eecb263d646bc755cff 2023-02-10 07:55:48,082 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/29eebf9f53874b62a76bed618f827705 2023-02-10 07:55:48,086 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/5049804aed5c471db9aaadd070b5c685 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/5049804aed5c471db9aaadd070b5c685 2023-02-10 07:55:48,089 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/5049804aed5c471db9aaadd070b5c685, entries=4, sequenceid=5, filesize=5.4 K 2023-02-10 07:55:48,089 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/29eebf9f53874b62a76bed618f827705 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/29eebf9f53874b62a76bed618f827705 2023-02-10 07:55:48,093 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/29eebf9f53874b62a76bed618f827705, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:55:48,094 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7b3e442243ba917643e7f579e42fd52b in 1254ms, sequenceid=5, compaction requested=false 2023-02-10 07:55:48,094 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b3e442243ba917643e7f579e42fd52b: 2023-02-10 07:55:48,094 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:48,094 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:48,481 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/84af5d9cee0048299214ed39dcc61d2f 2023-02-10 07:55:48,486 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/f95ea2d11b014b6387477663c12497f4 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/f95ea2d11b014b6387477663c12497f4 2023-02-10 07:55:48,490 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/f95ea2d11b014b6387477663c12497f4, entries=4, sequenceid=5, filesize=5.4 K 2023-02-10 07:55:48,490 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/84af5d9cee0048299214ed39dcc61d2f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/84af5d9cee0048299214ed39dcc61d2f 2023-02-10 07:55:48,494 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/84af5d9cee0048299214ed39dcc61d2f, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:55:48,494 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ad05c8b2ddd0721f147299fc051d2e1b in 1653ms, sequenceid=5, compaction requested=false 2023-02-10 07:55:48,494 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ad05c8b2ddd0721f147299fc051d2e1b: 2023-02-10 07:55:48,494 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:48,495 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:48,495 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:48,495 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,495 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-10 07:55:48,495 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-10 07:55:48,496 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,497 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:48,497 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:48,497 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:48,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-10 07:55:48,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24afe6ea[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:48,498 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-10 07:55:48,498 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:48,500 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:48,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:48,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:48,500 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-10 07:55:48,500 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-10 07:55:48,500 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:48,500 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,500 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-10 07:55:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:48,502 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,502 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-10 07:55:48,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:48,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:48,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:48,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:48,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-10 07:55:48,505 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-10 07:55:48,505 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:48,505 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:48,505 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-10 07:55:48,505 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:48,507 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,507 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:48,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,507 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:48,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:48,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:48,508 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:48,509 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:48,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-10 07:55:48,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,511 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:48,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:48,511 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:48,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-10 07:55:48,512 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:48,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:48,612 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:48,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:48,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:48,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:48,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:48,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:48,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:48,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-10 07:55:48,618 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-10 07:55:48,618 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:48,618 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-10 07:55:48,618 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-10 07:55:48,618 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,618 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:48,620 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:48,620 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:48,620 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:48,620 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:48,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:48,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:48,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:48,621 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-10 07:55:48,621 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-10 07:55:48,622 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-10 07:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-10 07:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-10 07:55:48,622 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:48,622 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:48,622 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:48,622 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:48,622 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. started... 2023-02-10 07:55:48,623 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. started... 2023-02-10 07:55:48,622 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. started... 2023-02-10 07:55:48,623 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b3e442243ba917643e7f579e42fd52b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:55:48,623 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ad05c8b2ddd0721f147299fc051d2e1b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:55:48,623 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c9dc8a10e21dc7c3a80e8fe5db00b967 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:55:48,650 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210cf41d599e38a43c9a12115bf7380ceb4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230210cf41d599e38a43c9a12115bf7380ceb4 2023-02-10 07:55:49,051 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210ba797c9f08eb4645b70eb8d7b9692cde to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230210ba797c9f08eb4645b70eb8d7b9692cde 2023-02-10 07:55:49,051 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021054df3050d80b4bedb7b355628794f83e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021054df3050d80b4bedb7b355628794f83e 2023-02-10 07:55:49,060 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/467c6539e02c400c93205fc5fd5384da 2023-02-10 07:55:49,065 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/6d6d7aa745244a57aeb02015e2c27ef3 2023-02-10 07:55:49,078 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210243c7329a4724188ac2831f552182c25 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230210243c7329a4724188ac2831f552182c25 2023-02-10 07:55:49,095 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/b0110bcebc7e46af97e3f9fb8945059c 2023-02-10 07:55:49,099 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210717e959350174cee8f579348e65dc72b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230210717e959350174cee8f579348e65dc72b 2023-02-10 07:55:49,101 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/467c6539e02c400c93205fc5fd5384da as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/467c6539e02c400c93205fc5fd5384da 2023-02-10 07:55:49,112 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/467c6539e02c400c93205fc5fd5384da, entries=4, sequenceid=9, filesize=5.4 K 2023-02-10 07:55:49,115 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/b0110bcebc7e46af97e3f9fb8945059c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/b0110bcebc7e46af97e3f9fb8945059c 2023-02-10 07:55:49,119 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/b0110bcebc7e46af97e3f9fb8945059c, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:55:49,120 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c9dc8a10e21dc7c3a80e8fe5db00b967 in 497ms, sequenceid=9, compaction requested=false 2023-02-10 07:55:49,120 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c9dc8a10e21dc7c3a80e8fe5db00b967: 2023-02-10 07:55:49,120 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:49,120 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:49,126 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/755111fc292a4a7cb544c1409b334aba 2023-02-10 07:55:49,131 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/6d6d7aa745244a57aeb02015e2c27ef3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/6d6d7aa745244a57aeb02015e2c27ef3 2023-02-10 07:55:49,135 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/6d6d7aa745244a57aeb02015e2c27ef3, entries=4, sequenceid=9, filesize=5.4 K 2023-02-10 07:55:49,136 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/755111fc292a4a7cb544c1409b334aba as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/755111fc292a4a7cb544c1409b334aba 2023-02-10 07:55:49,140 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/755111fc292a4a7cb544c1409b334aba, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:55:49,142 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ad05c8b2ddd0721f147299fc051d2e1b in 519ms, sequenceid=9, compaction requested=false 2023-02-10 07:55:49,142 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ad05c8b2ddd0721f147299fc051d2e1b: 2023-02-10 07:55:49,142 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:49,142 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:49,464 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/bc0b09ec3302485ea1082f4874d7d776 2023-02-10 07:55:49,878 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210b00c96f1e9ae4459a15c9b1a5afc40d7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230210b00c96f1e9ae4459a15c9b1a5afc40d7 2023-02-10 07:55:49,883 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/a6df66566bc74fc8b9da4b37c305dd4c 2023-02-10 07:55:49,887 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/bc0b09ec3302485ea1082f4874d7d776 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/bc0b09ec3302485ea1082f4874d7d776 2023-02-10 07:55:49,890 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/bc0b09ec3302485ea1082f4874d7d776, entries=4, sequenceid=9, filesize=5.4 K 2023-02-10 07:55:49,891 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/a6df66566bc74fc8b9da4b37c305dd4c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/a6df66566bc74fc8b9da4b37c305dd4c 2023-02-10 07:55:49,894 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/a6df66566bc74fc8b9da4b37c305dd4c, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:55:49,894 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7b3e442243ba917643e7f579e42fd52b in 1271ms, sequenceid=9, compaction requested=false 2023-02-10 07:55:49,895 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b3e442243ba917643e7f579e42fd52b: 2023-02-10 07:55:49,895 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:49,895 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:49,895 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:49,895 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,895 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-10 07:55:49,895 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-10 07:55:49,896 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,896 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:49,897 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:49,897 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:49,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:49,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-10 07:55:49,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f06db04[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:49,898 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-10 07:55:49,898 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:49,899 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:49,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:49,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:49,900 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-10 07:55:49,900 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-10 07:55:49,900 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:49,900 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,900 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:49,904 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-10 07:55:49,904 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,904 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,904 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-10 07:55:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:49,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:49,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:49,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-10 07:55:49,906 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-10 07:55:49,906 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:49,906 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:49,906 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-10 07:55:49,906 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:49,908 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:49,908 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:49,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:49,908 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:49,909 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:49,910 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:49,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:49,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-10 07:55:49,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:49,912 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:49,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:49,912 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:49,913 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:49,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:49,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:50,013 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:50,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:50,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:50,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:50,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:50,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:50,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:50,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-10 07:55:50,019 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-10 07:55:50,019 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:50,019 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-10 07:55:50,019 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-10 07:55:50,019 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:50,019 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:50,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:50,021 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:50,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:50,021 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:50,022 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:50,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:50,022 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-10 07:55:50,022 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-10 07:55:50,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-10 07:55:50,023 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-10 07:55:50,023 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:50,023 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-10 07:55:50,024 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:50,024 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:50,024 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:50,024 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:50,024 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. started... 2023-02-10 07:55:50,024 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. started... 2023-02-10 07:55:50,024 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. started... 2023-02-10 07:55:50,024 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c9dc8a10e21dc7c3a80e8fe5db00b967 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:55:50,024 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ad05c8b2ddd0721f147299fc051d2e1b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:55:50,024 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b3e442243ba917643e7f579e42fd52b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:55:50,449 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302105a9b5ab226f4488983c5f7523fe6fc4f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302105a9b5ab226f4488983c5f7523fe6fc4f 2023-02-10 07:55:50,449 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210f37c4585ff814584bcfb2eb93f5a59af to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230210f37c4585ff814584bcfb2eb93f5a59af 2023-02-10 07:55:50,449 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210fa9ba9beca1d4acab4ce640efd636347 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230210fa9ba9beca1d4acab4ce640efd636347 2023-02-10 07:55:50,460 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/11e7ff2c4fb84ec69f43baf654322613 2023-02-10 07:55:50,858 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/afa7299079744a95bbd37a571ceafcc4 2023-02-10 07:55:50,859 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/ba0b30f35b3845c0ac450bdba3ff3d21 2023-02-10 07:55:50,872 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021099686382658d4b3895ebd36d14cabae4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021099686382658d4b3895ebd36d14cabae4 2023-02-10 07:55:51,272 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302100d9906674dfc4713846ecf8348ef11cd to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302100d9906674dfc4713846ecf8348ef11cd 2023-02-10 07:55:51,272 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021076cc0547361f4bb89ccc4282f8a8fe1a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021076cc0547361f4bb89ccc4282f8a8fe1a 2023-02-10 07:55:51,277 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/40c38b52e1a1444482a3bb3e27520a13 2023-02-10 07:55:51,282 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/11e7ff2c4fb84ec69f43baf654322613 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/11e7ff2c4fb84ec69f43baf654322613 2023-02-10 07:55:51,285 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/11e7ff2c4fb84ec69f43baf654322613, entries=4, sequenceid=13, filesize=5.4 K 2023-02-10 07:55:51,285 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/40c38b52e1a1444482a3bb3e27520a13 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/40c38b52e1a1444482a3bb3e27520a13 2023-02-10 07:55:51,288 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/40c38b52e1a1444482a3bb3e27520a13, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:55:51,289 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7b3e442243ba917643e7f579e42fd52b in 1265ms, sequenceid=13, compaction requested=true 2023-02-10 07:55:51,289 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b3e442243ba917643e7f579e42fd52b: 2023-02-10 07:55:51,289 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:51,289 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:51,358 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:55:51,679 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/3ffd9725391d493b97b0866c24ce203c 2023-02-10 07:55:51,679 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/788e63d8e29c4c48bdecd5355397f00c 2023-02-10 07:55:51,683 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/afa7299079744a95bbd37a571ceafcc4 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/afa7299079744a95bbd37a571ceafcc4 2023-02-10 07:55:51,684 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/ba0b30f35b3845c0ac450bdba3ff3d21 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ba0b30f35b3845c0ac450bdba3ff3d21 2023-02-10 07:55:51,687 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/afa7299079744a95bbd37a571ceafcc4, entries=4, sequenceid=13, filesize=5.4 K 2023-02-10 07:55:51,687 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ba0b30f35b3845c0ac450bdba3ff3d21, entries=4, sequenceid=13, filesize=5.4 K 2023-02-10 07:55:51,688 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/3ffd9725391d493b97b0866c24ce203c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/3ffd9725391d493b97b0866c24ce203c 2023-02-10 07:55:51,688 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/788e63d8e29c4c48bdecd5355397f00c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/788e63d8e29c4c48bdecd5355397f00c 2023-02-10 07:55:51,692 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/3ffd9725391d493b97b0866c24ce203c, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:55:51,692 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/788e63d8e29c4c48bdecd5355397f00c, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:55:51,693 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ad05c8b2ddd0721f147299fc051d2e1b in 1669ms, sequenceid=13, compaction requested=true 2023-02-10 07:55:51,693 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c9dc8a10e21dc7c3a80e8fe5db00b967 in 1669ms, sequenceid=13, compaction requested=true 2023-02-10 07:55:51,693 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ad05c8b2ddd0721f147299fc051d2e1b: 2023-02-10 07:55:51,693 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:51,693 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c9dc8a10e21dc7c3a80e8fe5db00b967: 2023-02-10 07:55:51,693 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:51,693 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:51,693 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:51,693 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:51,693 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,693 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-10 07:55:51,693 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-10 07:55:51,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:51,695 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:51,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:51,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:51,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:51,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:51,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:51,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:51,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:51,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-10 07:55:51,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@569fc0f3[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:51,697 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-10 07:55:51,697 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:51,698 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:51,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:51,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:51,698 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-10 07:55:51,698 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-10 07:55:51,698 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:51,698 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,698 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:51,699 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,699 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-10 07:55:51,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:51,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:51,699 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:51,699 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-10 07:55:51,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:51,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:51,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:51,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:51,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:51,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:51,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-10 07:55:51,701 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-10 07:55:51,701 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:51,701 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:51,702 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-10 07:55:51,702 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:51,705 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,705 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,705 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:51,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:51,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:51,706 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:51,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:51,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:51,707 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:51,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:51,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,709 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,709 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:51,709 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:51,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:51,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:51,709 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:51,709 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:51,709 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:51,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-10 07:55:51,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-10 07:55:51,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:51,709 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:51,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:51,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:51,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:51,710 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,710 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:51,710 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:51,810 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:51,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:51,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:51,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:51,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:55:51,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:51,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:51,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-10 07:55:51,817 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-10 07:55:51,817 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:51,817 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-10 07:55:51,817 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-10 07:55:51,817 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,817 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:51,818 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:51,818 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:51,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:51,819 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:51,819 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:51,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:51,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:51,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:51,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:51,820 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-10 07:55:51,820 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-10 07:55:51,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-10 07:55:51,820 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-10 07:55:51,820 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:51,820 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-10 07:55:51,821 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:51,821 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. started... 2023-02-10 07:55:51,821 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:51,821 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:51,821 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b3e442243ba917643e7f579e42fd52b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:55:51,821 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:51,821 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:51,821 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. started... 2023-02-10 07:55:51,821 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. started... 2023-02-10 07:55:51,821 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ad05c8b2ddd0721f147299fc051d2e1b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:55:51,821 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c9dc8a10e21dc7c3a80e8fe5db00b967 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:55:52,235 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210bb2b28828ebb46f3af65a974c861f224 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230210bb2b28828ebb46f3af65a974c861f224 2023-02-10 07:55:52,244 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302102715f067977a4c2781027ade1043cc64 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302102715f067977a4c2781027ade1043cc64 2023-02-10 07:55:52,249 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210be44307457f94a268b6835fcdf0167ab to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230210be44307457f94a268b6835fcdf0167ab 2023-02-10 07:55:52,264 WARN [DataStreamer for file /user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/8bcde682ade24a3fa16a43a4e21d4338] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-02-10 07:55:52,264 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/8bcde682ade24a3fa16a43a4e21d4338 2023-02-10 07:55:52,647 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/c94cc00dcf74459882249976720b9c76 2023-02-10 07:55:52,654 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/e4ad0359532c4d55abfc0c3f9eb4ebd0 2023-02-10 07:55:52,687 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302104a9a93e2de0e4820aebd47efb3fdb1f0 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302104a9a93e2de0e4820aebd47efb3fdb1f0 2023-02-10 07:55:53,061 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210e552094989df4b11a1e06a3fad4e0408 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230210e552094989df4b11a1e06a3fad4e0408 2023-02-10 07:55:53,066 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/ec4e73b066d442228a514992d002f2f3 2023-02-10 07:55:53,066 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302101360658138de41b9a52aabb71fc90fb2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302101360658138de41b9a52aabb71fc90fb2 2023-02-10 07:55:53,069 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/c94cc00dcf74459882249976720b9c76 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/c94cc00dcf74459882249976720b9c76 2023-02-10 07:55:53,071 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/67b5320fe046474c85f5caa55f912dfe 2023-02-10 07:55:53,077 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/c94cc00dcf74459882249976720b9c76, entries=4, sequenceid=17, filesize=5.4 K 2023-02-10 07:55:53,078 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/ec4e73b066d442228a514992d002f2f3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/ec4e73b066d442228a514992d002f2f3 2023-02-10 07:55:53,079 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/e4ad0359532c4d55abfc0c3f9eb4ebd0 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/e4ad0359532c4d55abfc0c3f9eb4ebd0 2023-02-10 07:55:53,082 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/ec4e73b066d442228a514992d002f2f3, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:55:53,082 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/e4ad0359532c4d55abfc0c3f9eb4ebd0, entries=4, sequenceid=17, filesize=5.4 K 2023-02-10 07:55:53,082 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7b3e442243ba917643e7f579e42fd52b in 1261ms, sequenceid=17, compaction requested=true 2023-02-10 07:55:53,082 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b3e442243ba917643e7f579e42fd52b: 2023-02-10 07:55:53,082 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:53,083 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:53,083 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/67b5320fe046474c85f5caa55f912dfe as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/67b5320fe046474c85f5caa55f912dfe 2023-02-10 07:55:53,086 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/67b5320fe046474c85f5caa55f912dfe, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:55:53,086 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ad05c8b2ddd0721f147299fc051d2e1b in 1265ms, sequenceid=17, compaction requested=true 2023-02-10 07:55:53,086 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ad05c8b2ddd0721f147299fc051d2e1b: 2023-02-10 07:55:53,087 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:53,087 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:53,092 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/8cc8221ee47e425d9e3b22d2e7fb3902 2023-02-10 07:55:53,095 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/8bcde682ade24a3fa16a43a4e21d4338 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/8bcde682ade24a3fa16a43a4e21d4338 2023-02-10 07:55:53,099 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/8bcde682ade24a3fa16a43a4e21d4338, entries=4, sequenceid=17, filesize=5.4 K 2023-02-10 07:55:53,099 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/8cc8221ee47e425d9e3b22d2e7fb3902 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/8cc8221ee47e425d9e3b22d2e7fb3902 2023-02-10 07:55:53,102 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/8cc8221ee47e425d9e3b22d2e7fb3902, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:55:53,103 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c9dc8a10e21dc7c3a80e8fe5db00b967 in 1282ms, sequenceid=17, compaction requested=true 2023-02-10 07:55:53,103 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c9dc8a10e21dc7c3a80e8fe5db00b967: 2023-02-10 07:55:53,103 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:53,103 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:53,103 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:53,103 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,103 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-10 07:55:53,103 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-10 07:55:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:53,105 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:53,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:53,105 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:53,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:53,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:53,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:53,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:53,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-10 07:55:53,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@455ff895[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:53,107 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-10 07:55:53,107 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:53,110 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:53,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:53,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:53,110 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-10 07:55:53,110 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-10 07:55:53,110 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,110 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:53,110 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:53,111 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-10 07:55:53,111 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,111 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:53,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,112 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-10 07:55:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:53,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:53,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:53,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-10 07:55:53,114 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-10 07:55:53,114 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:53,114 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:53,114 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-10 07:55:53,114 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:53,116 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,116 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,116 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:53,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:53,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:53,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:53,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:53,117 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:53,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:53,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:53,118 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:53,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:53,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:53,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:53,120 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:53,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-10 07:55:53,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:53,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,120 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:53,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:53,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:53,121 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:53,221 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:53,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:53,233 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:53,243 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:53,254 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:55:53,255 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:55:53,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:55:53,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-10 07:55:53,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-10 07:55:53,290 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-10 07:55:53,290 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:53,290 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-10 07:55:53,290 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-10 07:55:53,291 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,291 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:53,293 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:53,293 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:53,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:53,293 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:53,293 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:55:53,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:53,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:53,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:55:53,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:53,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-10 07:55:53,294 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-10 07:55:53,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-10 07:55:53,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-10 07:55:53,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:55:53,294 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-10 07:55:53,296 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:53,296 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. started... 2023-02-10 07:55:53,296 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b3e442243ba917643e7f579e42fd52b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:55:53,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:55:53,299 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:55:53,299 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:53,299 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:53,299 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. started... 2023-02-10 07:55:53,299 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. started... 2023-02-10 07:55:53,299 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing ad05c8b2ddd0721f147299fc051d2e1b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:55:53,299 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c9dc8a10e21dc7c3a80e8fe5db00b967 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:55:54,121 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/8c812d4563884c0dadf94143f8bf5c29 2023-02-10 07:55:54,121 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/a1d008a684124096a3e7472456d8cd43 2023-02-10 07:55:54,121 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/fd855bd2b55747e59fa00e1beec85b04 2023-02-10 07:55:54,128 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fd855bd2b55747e59fa00e1beec85b04 2023-02-10 07:55:54,131 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1d008a684124096a3e7472456d8cd43 2023-02-10 07:55:54,134 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c812d4563884c0dadf94143f8bf5c29 2023-02-10 07:55:54,582 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/30242470a197408993a49e74f6eea014 2023-02-10 07:55:54,583 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/20121feacc8f48f3bf5e8cd681165af5 2023-02-10 07:55:54,587 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30242470a197408993a49e74f6eea014 2023-02-10 07:55:54,587 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20121feacc8f48f3bf5e8cd681165af5 2023-02-10 07:55:54,589 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/fd855bd2b55747e59fa00e1beec85b04 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/fd855bd2b55747e59fa00e1beec85b04 2023-02-10 07:55:54,589 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/a1d008a684124096a3e7472456d8cd43 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a1d008a684124096a3e7472456d8cd43 2023-02-10 07:55:54,593 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fd855bd2b55747e59fa00e1beec85b04 2023-02-10 07:55:54,593 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1d008a684124096a3e7472456d8cd43 2023-02-10 07:55:54,593 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/fd855bd2b55747e59fa00e1beec85b04, entries=3, sequenceid=23, filesize=5.0 K 2023-02-10 07:55:54,593 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a1d008a684124096a3e7472456d8cd43, entries=3, sequenceid=23, filesize=5.0 K 2023-02-10 07:55:54,594 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/30242470a197408993a49e74f6eea014 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/30242470a197408993a49e74f6eea014 2023-02-10 07:55:54,594 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/20121feacc8f48f3bf5e8cd681165af5 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/20121feacc8f48f3bf5e8cd681165af5 2023-02-10 07:55:54,598 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30242470a197408993a49e74f6eea014 2023-02-10 07:55:54,598 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 20121feacc8f48f3bf5e8cd681165af5 2023-02-10 07:55:54,598 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/30242470a197408993a49e74f6eea014, entries=1, sequenceid=23, filesize=5.0 K 2023-02-10 07:55:54,598 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/20121feacc8f48f3bf5e8cd681165af5, entries=1, sequenceid=23, filesize=5.0 K 2023-02-10 07:55:54,599 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7b3e442243ba917643e7f579e42fd52b in 1303ms, sequenceid=23, compaction requested=true 2023-02-10 07:55:54,599 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c9dc8a10e21dc7c3a80e8fe5db00b967 in 1300ms, sequenceid=23, compaction requested=true 2023-02-10 07:55:54,599 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b3e442243ba917643e7f579e42fd52b: 2023-02-10 07:55:54,599 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c9dc8a10e21dc7c3a80e8fe5db00b967: 2023-02-10 07:55:54,599 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:54,599 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:54,599 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:55:54,599 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:55:54,978 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/6ec122196534470196ab80f99b94c5b7 2023-02-10 07:55:54,983 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ec122196534470196ab80f99b94c5b7 2023-02-10 07:55:54,983 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/8c812d4563884c0dadf94143f8bf5c29 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/8c812d4563884c0dadf94143f8bf5c29 2023-02-10 07:55:54,987 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c812d4563884c0dadf94143f8bf5c29 2023-02-10 07:55:54,988 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/8c812d4563884c0dadf94143f8bf5c29, entries=3, sequenceid=23, filesize=5.0 K 2023-02-10 07:55:54,988 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/6ec122196534470196ab80f99b94c5b7 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/6ec122196534470196ab80f99b94c5b7 2023-02-10 07:55:54,992 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ec122196534470196ab80f99b94c5b7 2023-02-10 07:55:54,993 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/6ec122196534470196ab80f99b94c5b7, entries=1, sequenceid=23, filesize=5.0 K 2023-02-10 07:55:54,993 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ad05c8b2ddd0721f147299fc051d2e1b in 1694ms, sequenceid=23, compaction requested=true 2023-02-10 07:55:54,994 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ad05c8b2ddd0721f147299fc051d2e1b: 2023-02-10 07:55:54,994 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:55:54,994 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:55:54,994 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:55:54,994 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:54,994 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-10 07:55:54,994 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-10 07:55:54,995 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:54,996 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:54,996 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:54,996 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:55:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:54,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:54,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:54,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:54,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-10 07:55:54,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e1cce62[Count = 0] remaining members to acquire global barrier 2023-02-10 07:55:54,998 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-10 07:55:54,998 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:54,999 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:54,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:54,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:54,999 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-10 07:55:54,999 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:54,999 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:55:54,999 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-10 07:55:54,999 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:55:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-10 07:55:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:55,001 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-10 07:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:55:55,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-10 07:55:55,003 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-10 07:55:55,003 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:55:55,003 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:55:55,003 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-10 07:55:55,003 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:55:55,017 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:55,017 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:55,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:55:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:55:55,017 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:55,017 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:55:55,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:55:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:55,018 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:55:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-10 07:55:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-10 07:55:55,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:55:55,021 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:55:55,021 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:55:55,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:55:55,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:55:55,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:55:55,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-10 07:55:55,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:55:55,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:55:55,022 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-10 07:55:55,022 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:55:55,122 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:55:55,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:55:55,123 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:55,124 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 7b3e442243ba917643e7f579e42fd52b/family1 is initiating major compaction (all files) 2023-02-10 07:55:55,124 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:55,124 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:55,125 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 7b3e442243ba917643e7f579e42fd52b/family1 in ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:55,125 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/5049804aed5c471db9aaadd070b5c685, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/bc0b09ec3302485ea1082f4874d7d776, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/11e7ff2c4fb84ec69f43baf654322613, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/c94cc00dcf74459882249976720b9c76, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/fd855bd2b55747e59fa00e1beec85b04] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp, totalSize=26.6 K 2023-02-10 07:55:55,126 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 5049804aed5c471db9aaadd070b5c685, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015746831 2023-02-10 07:55:55,126 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting bc0b09ec3302485ea1082f4874d7d776, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015748614 2023-02-10 07:55:55,126 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 11e7ff2c4fb84ec69f43baf654322613, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015750015 2023-02-10 07:55:55,126 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting c94cc00dcf74459882249976720b9c76, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015751812 2023-02-10 07:55:55,127 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting fd855bd2b55747e59fa00e1beec85b04, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:55:55,136 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 7b3e442243ba917643e7f579e42fd52b#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:55,544 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302106fcb6e814ac046a88bc864c044d44c70_del 2023-02-10 07:55:55,544 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302106fcb6e814ac046a88bc864c044d44c70_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302106fcb6e814ac046a88bc864c044d44c70_del 2023-02-10 07:55:56,358 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4683df5755ee4550bf5c698e019249ae 2023-02-10 07:55:56,359 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family1/4683df5755ee4550bf5c698e019249ae as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/4683df5755ee4550bf5c698e019249ae 2023-02-10 07:55:56,362 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4683df5755ee4550bf5c698e019249ae 2023-02-10 07:55:56,363 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b3e442243ba917643e7f579e42fd52b/family1 of 7b3e442243ba917643e7f579e42fd52b into 4683df5755ee4550bf5c698e019249ae(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:56,363 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 7b3e442243ba917643e7f579e42fd52b: 2023-02-10 07:55:56,363 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:56,364 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 7b3e442243ba917643e7f579e42fd52b/family2 is initiating major compaction (all files) 2023-02-10 07:55:56,364 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:56,364 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:56,364 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 7b3e442243ba917643e7f579e42fd52b/family2 in ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:55:56,364 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/29eebf9f53874b62a76bed618f827705, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/a6df66566bc74fc8b9da4b37c305dd4c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/40c38b52e1a1444482a3bb3e27520a13, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/ec4e73b066d442228a514992d002f2f3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/30242470a197408993a49e74f6eea014] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp, totalSize=25.3 K 2023-02-10 07:55:56,364 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 29eebf9f53874b62a76bed618f827705, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015746831 2023-02-10 07:55:56,365 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting a6df66566bc74fc8b9da4b37c305dd4c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015748614 2023-02-10 07:55:56,365 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 40c38b52e1a1444482a3bb3e27520a13, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015750015 2023-02-10 07:55:56,365 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting ec4e73b066d442228a514992d002f2f3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015751812 2023-02-10 07:55:56,366 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 30242470a197408993a49e74f6eea014, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:55:56,375 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 7b3e442243ba917643e7f579e42fd52b#family2#compaction#151 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:56,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/5049804aed5c471db9aaadd070b5c685, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/bc0b09ec3302485ea1082f4874d7d776, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/11e7ff2c4fb84ec69f43baf654322613, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/c94cc00dcf74459882249976720b9c76, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/fd855bd2b55747e59fa00e1beec85b04] to archive 2023-02-10 07:55:56,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:56,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/5049804aed5c471db9aaadd070b5c685 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/5049804aed5c471db9aaadd070b5c685 2023-02-10 07:55:56,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/bc0b09ec3302485ea1082f4874d7d776 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/bc0b09ec3302485ea1082f4874d7d776 2023-02-10 07:55:56,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/11e7ff2c4fb84ec69f43baf654322613 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/11e7ff2c4fb84ec69f43baf654322613 2023-02-10 07:55:56,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/c94cc00dcf74459882249976720b9c76 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/c94cc00dcf74459882249976720b9c76 2023-02-10 07:55:56,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/fd855bd2b55747e59fa00e1beec85b04 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/fd855bd2b55747e59fa00e1beec85b04 2023-02-10 07:55:56,786 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302103bb4e50b92a745549e93acf2012a5899_del 2023-02-10 07:55:56,786 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302103bb4e50b92a745549e93acf2012a5899_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302103bb4e50b92a745549e93acf2012a5899_del 2023-02-10 07:55:57,602 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28be34e5cb1c47a484a7f9046031bf66 2023-02-10 07:55:57,603 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/.tmp/family2/28be34e5cb1c47a484a7f9046031bf66 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/28be34e5cb1c47a484a7f9046031bf66 2023-02-10 07:55:57,606 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28be34e5cb1c47a484a7f9046031bf66 2023-02-10 07:55:57,607 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b3e442243ba917643e7f579e42fd52b/family2 of 7b3e442243ba917643e7f579e42fd52b into 28be34e5cb1c47a484a7f9046031bf66(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:57,607 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 7b3e442243ba917643e7f579e42fd52b: 2023-02-10 07:55:57,607 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:57,607 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): c9dc8a10e21dc7c3a80e8fe5db00b967/family1 is initiating major compaction (all files) 2023-02-10 07:55:57,607 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:57,607 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:57,608 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of c9dc8a10e21dc7c3a80e8fe5db00b967/family1 in ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:57,608 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/96bfaefd62bc46d7869db53b846d7131, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/467c6539e02c400c93205fc5fd5384da, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/afa7299079744a95bbd37a571ceafcc4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/8bcde682ade24a3fa16a43a4e21d4338, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a1d008a684124096a3e7472456d8cd43] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp, totalSize=26.6 K 2023-02-10 07:55:57,609 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 96bfaefd62bc46d7869db53b846d7131, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015746830 2023-02-10 07:55:57,609 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 467c6539e02c400c93205fc5fd5384da, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015748614 2023-02-10 07:55:57,609 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting afa7299079744a95bbd37a571ceafcc4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015750014 2023-02-10 07:55:57,610 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 8bcde682ade24a3fa16a43a4e21d4338, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015751812 2023-02-10 07:55:57,610 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting a1d008a684124096a3e7472456d8cd43, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:55:57,623 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): c9dc8a10e21dc7c3a80e8fe5db00b967#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:57,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/29eebf9f53874b62a76bed618f827705, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/a6df66566bc74fc8b9da4b37c305dd4c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/40c38b52e1a1444482a3bb3e27520a13, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/ec4e73b066d442228a514992d002f2f3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/30242470a197408993a49e74f6eea014] to archive 2023-02-10 07:55:57,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:57,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/29eebf9f53874b62a76bed618f827705 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/29eebf9f53874b62a76bed618f827705 2023-02-10 07:55:57,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/a6df66566bc74fc8b9da4b37c305dd4c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/a6df66566bc74fc8b9da4b37c305dd4c 2023-02-10 07:55:57,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/40c38b52e1a1444482a3bb3e27520a13 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/40c38b52e1a1444482a3bb3e27520a13 2023-02-10 07:55:57,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/ec4e73b066d442228a514992d002f2f3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/ec4e73b066d442228a514992d002f2f3 2023-02-10 07:55:57,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/30242470a197408993a49e74f6eea014 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family2/30242470a197408993a49e74f6eea014 2023-02-10 07:55:58,040 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021068ff7d49490d4851891711904e9b2064_del 2023-02-10 07:55:58,041 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021068ff7d49490d4851891711904e9b2064_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021068ff7d49490d4851891711904e9b2064_del 2023-02-10 07:55:58,863 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 796c0a936f3e491b994d0d4ff143d152 2023-02-10 07:55:58,864 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family1/796c0a936f3e491b994d0d4ff143d152 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/796c0a936f3e491b994d0d4ff143d152 2023-02-10 07:55:58,867 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 796c0a936f3e491b994d0d4ff143d152 2023-02-10 07:55:58,868 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c9dc8a10e21dc7c3a80e8fe5db00b967/family1 of c9dc8a10e21dc7c3a80e8fe5db00b967 into 796c0a936f3e491b994d0d4ff143d152(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:55:58,868 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for c9dc8a10e21dc7c3a80e8fe5db00b967: 2023-02-10 07:55:58,868 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:55:58,868 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): c9dc8a10e21dc7c3a80e8fe5db00b967/family2 is initiating major compaction (all files) 2023-02-10 07:55:58,868 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:55:58,868 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:55:58,868 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of c9dc8a10e21dc7c3a80e8fe5db00b967/family2 in ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:55:58,868 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/5d30834095ca479089e8614783b36529, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/b0110bcebc7e46af97e3f9fb8945059c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/788e63d8e29c4c48bdecd5355397f00c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/8cc8221ee47e425d9e3b22d2e7fb3902, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/20121feacc8f48f3bf5e8cd681165af5] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp, totalSize=25.3 K 2023-02-10 07:55:58,869 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 5d30834095ca479089e8614783b36529, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015746830 2023-02-10 07:55:58,869 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting b0110bcebc7e46af97e3f9fb8945059c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015748614 2023-02-10 07:55:58,869 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 788e63d8e29c4c48bdecd5355397f00c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015750014 2023-02-10 07:55:58,870 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 8cc8221ee47e425d9e3b22d2e7fb3902, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015751812 2023-02-10 07:55:58,870 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 20121feacc8f48f3bf5e8cd681165af5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:55:58,878 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): c9dc8a10e21dc7c3a80e8fe5db00b967#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:55:58,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/96bfaefd62bc46d7869db53b846d7131, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/467c6539e02c400c93205fc5fd5384da, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/afa7299079744a95bbd37a571ceafcc4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/8bcde682ade24a3fa16a43a4e21d4338, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a1d008a684124096a3e7472456d8cd43] to archive 2023-02-10 07:55:58,907 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:55:58,907 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e13a0e8 to 127.0.0.1:54857 2023-02-10 07:55:58,907 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:58,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:55:58,917 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:55:58,917 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78e7e520 to 127.0.0.1:54857 2023-02-10 07:55:58,917 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:55:58,918 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/96bfaefd62bc46d7869db53b846d7131 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/96bfaefd62bc46d7869db53b846d7131 2023-02-10 07:55:58,919 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/467c6539e02c400c93205fc5fd5384da to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/467c6539e02c400c93205fc5fd5384da 2023-02-10 07:55:58,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/afa7299079744a95bbd37a571ceafcc4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/afa7299079744a95bbd37a571ceafcc4 2023-02-10 07:55:58,921 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/8bcde682ade24a3fa16a43a4e21d4338 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/8bcde682ade24a3fa16a43a4e21d4338 2023-02-10 07:55:58,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a1d008a684124096a3e7472456d8cd43 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a1d008a684124096a3e7472456d8cd43 2023-02-10 07:55:59,324 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230210cb41643c5b2c43c483e9071f818c72f6_del 2023-02-10 07:55:59,324 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210cb41643c5b2c43c483e9071f818c72f6_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230210cb41643c5b2c43c483e9071f818c72f6_del 2023-02-10 07:56:00,139 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 442ab3edd25c4ff98a2bde1bbc942eea 2023-02-10 07:56:00,140 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/.tmp/family2/442ab3edd25c4ff98a2bde1bbc942eea as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/442ab3edd25c4ff98a2bde1bbc942eea 2023-02-10 07:56:00,143 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 442ab3edd25c4ff98a2bde1bbc942eea 2023-02-10 07:56:00,144 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c9dc8a10e21dc7c3a80e8fe5db00b967/family2 of c9dc8a10e21dc7c3a80e8fe5db00b967 into 442ab3edd25c4ff98a2bde1bbc942eea(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:56:00,144 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for c9dc8a10e21dc7c3a80e8fe5db00b967: 2023-02-10 07:56:00,145 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:56:00,145 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): ad05c8b2ddd0721f147299fc051d2e1b/family1 is initiating major compaction (all files) 2023-02-10 07:56:00,145 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:56:00,145 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:56:00,145 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of ad05c8b2ddd0721f147299fc051d2e1b/family1 in ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:56:00,145 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/f95ea2d11b014b6387477663c12497f4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/6d6d7aa745244a57aeb02015e2c27ef3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ba0b30f35b3845c0ac450bdba3ff3d21, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/e4ad0359532c4d55abfc0c3f9eb4ebd0, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/8c812d4563884c0dadf94143f8bf5c29] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp, totalSize=26.6 K 2023-02-10 07:56:00,145 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting f95ea2d11b014b6387477663c12497f4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015746831 2023-02-10 07:56:00,146 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 6d6d7aa745244a57aeb02015e2c27ef3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015748614 2023-02-10 07:56:00,146 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting ba0b30f35b3845c0ac450bdba3ff3d21, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015750015 2023-02-10 07:56:00,146 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting e4ad0359532c4d55abfc0c3f9eb4ebd0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015751812 2023-02-10 07:56:00,147 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 8c812d4563884c0dadf94143f8bf5c29, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:56:00,157 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): ad05c8b2ddd0721f147299fc051d2e1b#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:00,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/5d30834095ca479089e8614783b36529, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/b0110bcebc7e46af97e3f9fb8945059c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/788e63d8e29c4c48bdecd5355397f00c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/8cc8221ee47e425d9e3b22d2e7fb3902, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/20121feacc8f48f3bf5e8cd681165af5] to archive 2023-02-10 07:56:00,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:00,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/5d30834095ca479089e8614783b36529 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/5d30834095ca479089e8614783b36529 2023-02-10 07:56:00,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/b0110bcebc7e46af97e3f9fb8945059c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/b0110bcebc7e46af97e3f9fb8945059c 2023-02-10 07:56:00,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/788e63d8e29c4c48bdecd5355397f00c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/788e63d8e29c4c48bdecd5355397f00c 2023-02-10 07:56:00,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/8cc8221ee47e425d9e3b22d2e7fb3902 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/8cc8221ee47e425d9e3b22d2e7fb3902 2023-02-10 07:56:00,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/20121feacc8f48f3bf5e8cd681165af5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family2/20121feacc8f48f3bf5e8cd681165af5 2023-02-10 07:56:00,565 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230210bc2d52089d7b4f70bc8280a0892ea491_del 2023-02-10 07:56:00,565 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210bc2d52089d7b4f70bc8280a0892ea491_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230210bc2d52089d7b4f70bc8280a0892ea491_del 2023-02-10 07:56:01,379 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29deb4180ba844c5b28ba3e152c0184b 2023-02-10 07:56:01,380 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family1/29deb4180ba844c5b28ba3e152c0184b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/29deb4180ba844c5b28ba3e152c0184b 2023-02-10 07:56:01,385 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29deb4180ba844c5b28ba3e152c0184b 2023-02-10 07:56:01,386 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ad05c8b2ddd0721f147299fc051d2e1b/family1 of ad05c8b2ddd0721f147299fc051d2e1b into 29deb4180ba844c5b28ba3e152c0184b(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:56:01,386 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for ad05c8b2ddd0721f147299fc051d2e1b: 2023-02-10 07:56:01,386 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:56:01,386 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): ad05c8b2ddd0721f147299fc051d2e1b/family2 is initiating major compaction (all files) 2023-02-10 07:56:01,386 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:56:01,386 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:56:01,386 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of ad05c8b2ddd0721f147299fc051d2e1b/family2 in ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:56:01,386 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/84af5d9cee0048299214ed39dcc61d2f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/755111fc292a4a7cb544c1409b334aba, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/3ffd9725391d493b97b0866c24ce203c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/67b5320fe046474c85f5caa55f912dfe, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/6ec122196534470196ab80f99b94c5b7] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp, totalSize=25.3 K 2023-02-10 07:56:01,387 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 84af5d9cee0048299214ed39dcc61d2f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015746831 2023-02-10 07:56:01,387 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 755111fc292a4a7cb544c1409b334aba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015748614 2023-02-10 07:56:01,387 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 3ffd9725391d493b97b0866c24ce203c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015750015 2023-02-10 07:56:01,388 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 67b5320fe046474c85f5caa55f912dfe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015751812 2023-02-10 07:56:01,388 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 6ec122196534470196ab80f99b94c5b7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:56:01,396 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): ad05c8b2ddd0721f147299fc051d2e1b#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:01,403 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302106061a16c2cf64a67a9794f74e4bc4228_del 2023-02-10 07:56:01,403 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302106061a16c2cf64a67a9794f74e4bc4228_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302106061a16c2cf64a67a9794f74e4bc4228_del 2023-02-10 07:56:01,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/f95ea2d11b014b6387477663c12497f4, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/6d6d7aa745244a57aeb02015e2c27ef3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ba0b30f35b3845c0ac450bdba3ff3d21, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/e4ad0359532c4d55abfc0c3f9eb4ebd0, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/8c812d4563884c0dadf94143f8bf5c29] to archive 2023-02-10 07:56:01,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:01,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/f95ea2d11b014b6387477663c12497f4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/f95ea2d11b014b6387477663c12497f4 2023-02-10 07:56:01,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/6d6d7aa745244a57aeb02015e2c27ef3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/6d6d7aa745244a57aeb02015e2c27ef3 2023-02-10 07:56:01,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ba0b30f35b3845c0ac450bdba3ff3d21 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ba0b30f35b3845c0ac450bdba3ff3d21 2023-02-10 07:56:01,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/e4ad0359532c4d55abfc0c3f9eb4ebd0 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/e4ad0359532c4d55abfc0c3f9eb4ebd0 2023-02-10 07:56:01,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/8c812d4563884c0dadf94143f8bf5c29 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/8c812d4563884c0dadf94143f8bf5c29 2023-02-10 07:56:02,221 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 974498547d914e4d8dab91ba09c113e1 2023-02-10 07:56:02,222 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/.tmp/family2/974498547d914e4d8dab91ba09c113e1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/974498547d914e4d8dab91ba09c113e1 2023-02-10 07:56:02,227 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 974498547d914e4d8dab91ba09c113e1 2023-02-10 07:56:02,227 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ad05c8b2ddd0721f147299fc051d2e1b/family2 of ad05c8b2ddd0721f147299fc051d2e1b into 974498547d914e4d8dab91ba09c113e1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:56:02,228 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for ad05c8b2ddd0721f147299fc051d2e1b: 2023-02-10 07:56:02,231 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:02,234 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:02,237 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:02,238 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:02,242 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-10 07:56:02,255 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-10 07:56:02,258 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021068ff7d49490d4851891711904e9b2064_del 2023-02-10 07:56:02,261 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302106fcb6e814ac046a88bc864c044d44c70_del 2023-02-10 07:56:02,264 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230210bc2d52089d7b4f70bc8280a0892ea491_del 2023-02-10 07:56:02,264 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-10 07:56:02,264 DEBUG [Listener at localhost/46793] zookeeper.ReadOnlyZKClient(139): Connect 0x20d7c20f to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:56:02,269 DEBUG [Listener at localhost/46793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d841d14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:56:02,270 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230210 for table='ns:testMinorCompaction' and column='family1' 2023-02-10 07:56:02,270 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230210 for table='ns:testMinorCompaction' and column='family1' 2023-02-10 07:56:02,270 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230210 for table='ns:testMinorCompaction' and column='family1' 2023-02-10 07:56:02,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/84af5d9cee0048299214ed39dcc61d2f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/755111fc292a4a7cb544c1409b334aba, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/3ffd9725391d493b97b0866c24ce203c, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/67b5320fe046474c85f5caa55f912dfe, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/6ec122196534470196ab80f99b94c5b7] to archive 2023-02-10 07:56:02,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:02,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/84af5d9cee0048299214ed39dcc61d2f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/84af5d9cee0048299214ed39dcc61d2f 2023-02-10 07:56:02,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/755111fc292a4a7cb544c1409b334aba to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/755111fc292a4a7cb544c1409b334aba 2023-02-10 07:56:02,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/3ffd9725391d493b97b0866c24ce203c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/3ffd9725391d493b97b0866c24ce203c 2023-02-10 07:56:02,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/67b5320fe046474c85f5caa55f912dfe to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/67b5320fe046474c85f5caa55f912dfe 2023-02-10 07:56:02,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/6ec122196534470196ab80f99b94c5b7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family2/6ec122196534470196ab80f99b94c5b7 2023-02-10 07:56:03,114 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210a006e2d53dcd4a51bd3bd32c8a2ad37b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230210a006e2d53dcd4a51bd3bd32c8a2ad37b 2023-02-10 07:56:03,115 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230210 table='ns:testMinorCompaction' column='family1' 2023-02-10 07:56:03,118 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210a180b7c7e7e54344b6da4d2c9e9a016e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230210a180b7c7e7e54344b6da4d2c9e9a016e 2023-02-10 07:56:03,119 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='ns:testMinorCompaction' column='family1' 2023-02-10 07:56:03,128 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:56:03,129 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210e25f85af29a74a7a81238327879be4b1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230210e25f85af29a74a7a81238327879be4b1 2023-02-10 07:56:03,131 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60180, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:56:03,131 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='ns:testMinorCompaction' column='family1' 2023-02-10 07:56:03,149 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:56:03,153 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37594, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:56:03,186 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230210/family1/5e066fe667994b1689fd2c1a5b5b34c8 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-10 07:56:03,186 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230210/family1/4ba712c6440f4c41addc837aeef9f7a3 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-10 07:56:03,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230210/family1/5e066fe667994b1689fd2c1a5b5b34c8}] 2023-02-10 07:56:03,188 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230210/family1/4ba712c6440f4c41addc837aeef9f7a3}] 2023-02-10 07:56:03,188 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230210/family1/5609d37d9a6a4d06b3df9e94cb811ec3 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-10 07:56:03,191 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230210/family1/5609d37d9a6a4d06b3df9e94cb811ec3}] 2023-02-10 07:56:03,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230210/family1/5e066fe667994b1689fd2c1a5b5b34c8 for inclusion in ad05c8b2ddd0721f147299fc051d2e1b/family1 2023-02-10 07:56:03,194 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230210/family1/4ba712c6440f4c41addc837aeef9f7a3 for inclusion in c9dc8a10e21dc7c3a80e8fe5db00b967/family1 2023-02-10 07:56:03,195 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230210/family1/5609d37d9a6a4d06b3df9e94cb811ec3 for inclusion in 7b3e442243ba917643e7f579e42fd52b/family1 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for ad05c8b2ddd0721f147299fc051d2e1b: 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 7b3e442243ba917643e7f579e42fd52b: 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last=1 2023-02-10 07:56:03,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for c9dc8a10e21dc7c3a80e8fe5db00b967: 2023-02-10 07:56:03,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230210/family1/5e066fe667994b1689fd2c1a5b5b34c8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__qrkgoc5snf1vhj14gsq50f0flnld1guj4ris0fb41ubdrbrjgt52252fkkpfmmrp/family1/5e066fe667994b1689fd2c1a5b5b34c8 2023-02-10 07:56:03,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230210/family1/4ba712c6440f4c41addc837aeef9f7a3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__uojjs8hljlspt7r5bm8t410eu31d7rhftre94p9lha352vumrho3kni414bmdq4u/family1/4ba712c6440f4c41addc837aeef9f7a3 2023-02-10 07:56:03,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230210/family1/5609d37d9a6a4d06b3df9e94cb811ec3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__dgobnrn3f7j1ffhg6i528s3rkri0ps4ck86mggb90fagl0a672kg6l6ocrj85s17/family1/5609d37d9a6a4d06b3df9e94cb811ec3 2023-02-10 07:56:03,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__qrkgoc5snf1vhj14gsq50f0flnld1guj4ris0fb41ubdrbrjgt52252fkkpfmmrp/family1/5e066fe667994b1689fd2c1a5b5b34c8 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ec6737af9630469c8ddcfd7d8e5418e3_SeqId_28_ 2023-02-10 07:56:03,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__dgobnrn3f7j1ffhg6i528s3rkri0ps4ck86mggb90fagl0a672kg6l6ocrj85s17/family1/5609d37d9a6a4d06b3df9e94cb811ec3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/34a3993a4a01479686666802c45ae841_SeqId_28_ 2023-02-10 07:56:03,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__uojjs8hljlspt7r5bm8t410eu31d7rhftre94p9lha352vumrho3kni414bmdq4u/family1/4ba712c6440f4c41addc837aeef9f7a3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a86ab9d7040f4e998e174c52ee6066dd_SeqId_28_ 2023-02-10 07:56:03,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__qrkgoc5snf1vhj14gsq50f0flnld1guj4ris0fb41ubdrbrjgt52252fkkpfmmrp/family1/5e066fe667994b1689fd2c1a5b5b34c8 into ad05c8b2ddd0721f147299fc051d2e1b/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ec6737af9630469c8ddcfd7d8e5418e3_SeqId_28_ - updating store file list. 2023-02-10 07:56:03,203 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__uojjs8hljlspt7r5bm8t410eu31d7rhftre94p9lha352vumrho3kni414bmdq4u/family1/4ba712c6440f4c41addc837aeef9f7a3 into c9dc8a10e21dc7c3a80e8fe5db00b967/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a86ab9d7040f4e998e174c52ee6066dd_SeqId_28_ - updating store file list. 2023-02-10 07:56:03,203 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__dgobnrn3f7j1ffhg6i528s3rkri0ps4ck86mggb90fagl0a672kg6l6ocrj85s17/family1/5609d37d9a6a4d06b3df9e94cb811ec3 into 7b3e442243ba917643e7f579e42fd52b/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/34a3993a4a01479686666802c45ae841_SeqId_28_ - updating store file list. 2023-02-10 07:56:03,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/34a3993a4a01479686666802c45ae841_SeqId_28_ into 7b3e442243ba917643e7f579e42fd52b/family1 2023-02-10 07:56:03,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__dgobnrn3f7j1ffhg6i528s3rkri0ps4ck86mggb90fagl0a672kg6l6ocrj85s17/family1/5609d37d9a6a4d06b3df9e94cb811ec3 into 7b3e442243ba917643e7f579e42fd52b/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/family1/34a3993a4a01479686666802c45ae841_SeqId_28_) 2023-02-10 07:56:03,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ec6737af9630469c8ddcfd7d8e5418e3_SeqId_28_ into ad05c8b2ddd0721f147299fc051d2e1b/family1 2023-02-10 07:56:03,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__qrkgoc5snf1vhj14gsq50f0flnld1guj4ris0fb41ubdrbrjgt52252fkkpfmmrp/family1/5e066fe667994b1689fd2c1a5b5b34c8 into ad05c8b2ddd0721f147299fc051d2e1b/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/family1/ec6737af9630469c8ddcfd7d8e5418e3_SeqId_28_) 2023-02-10 07:56:03,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__dgobnrn3f7j1ffhg6i528s3rkri0ps4ck86mggb90fagl0a672kg6l6ocrj85s17/family1/5609d37d9a6a4d06b3df9e94cb811ec3 2023-02-10 07:56:03,208 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a86ab9d7040f4e998e174c52ee6066dd_SeqId_28_ into c9dc8a10e21dc7c3a80e8fe5db00b967/family1 2023-02-10 07:56:03,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__qrkgoc5snf1vhj14gsq50f0flnld1guj4ris0fb41ubdrbrjgt52252fkkpfmmrp/family1/5e066fe667994b1689fd2c1a5b5b34c8 2023-02-10 07:56:03,208 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__uojjs8hljlspt7r5bm8t410eu31d7rhftre94p9lha352vumrho3kni414bmdq4u/family1/4ba712c6440f4c41addc837aeef9f7a3 into c9dc8a10e21dc7c3a80e8fe5db00b967/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/family1/a86ab9d7040f4e998e174c52ee6066dd_SeqId_28_) 2023-02-10 07:56:03,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__ns_testMinorCompaction__uojjs8hljlspt7r5bm8t410eu31d7rhftre94p9lha352vumrho3kni414bmdq4u/family1/4ba712c6440f4c41addc837aeef9f7a3 2023-02-10 07:56:03,211 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230210 table='ns:testMinorCompaction' column='family1' 2023-02-10 07:56:03,211 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='ns:testMinorCompaction' column='family1' 2023-02-10 07:56:03,211 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='ns:testMinorCompaction' column='family1' 2023-02-10 07:56:03,212 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:03,212 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:03,212 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:03,213 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302105f62861d17be4954a6f54f017a18f333 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302105f62861d17be4954a6f54f017a18f333 2023-02-10 07:56:03,214 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-10 07:56:03,214 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230210' 2023-02-10 07:56:03,214 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302107da70ab20c3f4b6e95fac08ed527d5d5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302107da70ab20c3f4b6e95fac08ed527d5d5 2023-02-10 07:56:03,214 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-10 07:56:03,214 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230210' 2023-02-10 07:56:03,214 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302106bb00f07f1f8469084a241effa3f7706 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302106bb00f07f1f8469084a241effa3f7706 2023-02-10 07:56:03,214 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-10 07:56:03,214 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230210 for table='ns:testMinorCompaction' and column='family1' 2023-02-10 07:56:03,214 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230210 for table='ns:testMinorCompaction' and column='family1' 2023-02-10 07:56:03,214 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230210' 2023-02-10 07:56:03,215 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230210 for table='ns:testMinorCompaction' and column='family1' 2023-02-10 07:56:03,215 INFO [Listener at localhost/46793] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-10 07:56:03,217 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:03,220 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:03,222 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:03,223 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:03,245 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=248 (was 283), OpenFileDescriptor=623 (was 755), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=120 (was 87) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3338 (was 3163) - AvailableMemoryMB LEAK? - 2023-02-10 07:56:03,262 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=120, ProcessCount=168, AvailableMemoryMB=3337 2023-02-10 07:56:03,264 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-10 07:56:03,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:03,267 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:56:03,267 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-10 07:56:03,268 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:56:03,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-10 07:56:03,273 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:03,273 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be empty. 2023-02-10 07:56:03,274 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:03,274 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-10 07:56:03,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-10 07:56:03,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-10 07:56:03,685 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-10 07:56:03,686 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 44f0ab95b846f4a7edff1076e42206be, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:56:03,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-10 07:56:04,091 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:56:04,091 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 44f0ab95b846f4a7edff1076e42206be, disabling compactions & flushes 2023-02-10 07:56:04,091 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:04,092 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:04,092 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. after waiting 0 ms 2023-02-10 07:56:04,092 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:04,092 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:04,092 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 44f0ab95b846f4a7edff1076e42206be: Waiting for close lock at 1676015764091Disabling compacts and flushes for region at 1676015764091Disabling writes for close at 1676015764092 (+1 ms)Writing region close event to WAL at 1676015764092Closed at 1676015764092 2023-02-10 07:56:04,094 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:56:04,095 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676015764094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015764094"}]},"ts":"1676015764094"} 2023-02-10 07:56:04,096 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-10 07:56:04,096 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:56:04,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015764097"}]},"ts":"1676015764097"} 2023-02-10 07:56:04,097 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-10 07:56:04,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=44f0ab95b846f4a7edff1076e42206be, ASSIGN}] 2023-02-10 07:56:04,103 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=44f0ab95b846f4a7edff1076e42206be, ASSIGN 2023-02-10 07:56:04,103 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=44f0ab95b846f4a7edff1076e42206be, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:56:04,254 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=44f0ab95b846f4a7edff1076e42206be, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:04,254 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676015764254"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015764254"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015764254"}]},"ts":"1676015764254"} 2023-02-10 07:56:04,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 44f0ab95b846f4a7edff1076e42206be, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:56:04,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-10 07:56:04,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:04,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 44f0ab95b846f4a7edff1076e42206be, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be.', STARTKEY => '', ENDKEY => ''} 2023-02-10 07:56:04,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:04,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:56:04,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:04,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:04,412 INFO [StoreOpener-44f0ab95b846f4a7edff1076e42206be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:04,413 DEBUG [StoreOpener-44f0ab95b846f4a7edff1076e42206be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1 2023-02-10 07:56:04,413 DEBUG [StoreOpener-44f0ab95b846f4a7edff1076e42206be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1 2023-02-10 07:56:04,413 INFO [StoreOpener-44f0ab95b846f4a7edff1076e42206be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44f0ab95b846f4a7edff1076e42206be columnFamilyName family1 2023-02-10 07:56:04,415 INFO [StoreOpener-44f0ab95b846f4a7edff1076e42206be-1] regionserver.HStore(310): Store=44f0ab95b846f4a7edff1076e42206be/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:56:04,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:04,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:04,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:04,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:56:04,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 44f0ab95b846f4a7edff1076e42206be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67333579, jitterRate=0.003348514437675476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-10 07:56:04,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 44f0ab95b846f4a7edff1076e42206be: Running coprocessor pre-open hook at 1676015764411Writing region info on filesystem at 1676015764411Initializing all the Stores at 1676015764411Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676015764411Cleaning up temporary data from old regions at 1676015764416 (+5 ms)Cleaning up detritus from prior splits at 1676015764416Running coprocessor post-open hooks at 1676015764420 (+4 ms)Region opened successfully at 1676015764420 2023-02-10 07:56:04,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be., pid=114, masterSystemTime=1676015764407 2023-02-10 07:56:04,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:04,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:04,422 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=44f0ab95b846f4a7edff1076e42206be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:04,422 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676015764422"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015764422"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015764422"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015764422"}]},"ts":"1676015764422"} 2023-02-10 07:56:04,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-10 07:56:04,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 44f0ab95b846f4a7edff1076e42206be, server=jenkins-hbase4.apache.org,36907,1676015618909 in 167 msec 2023-02-10 07:56:04,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-10 07:56:04,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=44f0ab95b846f4a7edff1076e42206be, ASSIGN in 323 msec 2023-02-10 07:56:04,426 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:56:04,426 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015764426"}]},"ts":"1676015764426"} 2023-02-10 07:56:04,427 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-10 07:56:04,430 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:56:04,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1650 sec 2023-02-10 07:56:04,435 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:05,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-10 07:56:05,375 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-10 07:56:05,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:05,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:05,400 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:05,400 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:05,400 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:05,400 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:05,401 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:05,401 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:05,402 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:05,402 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:05,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:05,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:05,403 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:05,403 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:05,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:05,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:05,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:05,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:05,410 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:05,410 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:05,410 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:05,410 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:05,410 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:05,410 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:05,410 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:05,411 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-10 07:56:05,836 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113041e998450eae4d79b38e07e983c41e6e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113041e998450eae4d79b38e07e983c41e6e 2023-02-10 07:56:06,240 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/f6a711a0484c43a0be153a93ce9f0acb 2023-02-10 07:56:06,244 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/f6a711a0484c43a0be153a93ce9f0acb as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/f6a711a0484c43a0be153a93ce9f0acb 2023-02-10 07:56:06,247 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/f6a711a0484c43a0be153a93ce9f0acb, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-10 07:56:06,248 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 837ms, sequenceid=5, compaction requested=false 2023-02-10 07:56:06,249 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:06,249 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:06,249 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:06,249 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:06,249 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,249 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:06,249 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:06,250 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,250 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:06,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:06,251 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,251 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:06,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:06,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:06,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:06,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:06,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@570be85e[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:06,252 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:06,252 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,253 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,253 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,253 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:06,253 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:06,253 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:06,253 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:06,258 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:06,258 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,258 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:06,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:06,259 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:06,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:06,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:06,260 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:06,260 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:06,260 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:06,260 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,261 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:06,262 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,262 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:06,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:06,262 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:06,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,263 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:06,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,264 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:06,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,266 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,266 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,266 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,266 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:06,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:06,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:06,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:06,266 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:06,266 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:56:06,266 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:06,267 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:06,267 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,267 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:06,267 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:06,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:06,267 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:06,367 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:06,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:06,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:06,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:06,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,375 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:06,375 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:06,375 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:06,375 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:06,375 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,375 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,377 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,377 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:06,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:06,377 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:06,377 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:06,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,378 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,378 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:06,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:06,378 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:06,378 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:06,378 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:06,378 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:06,378 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:06,378 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:06,378 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:06,378 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-10 07:56:06,790 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e8234866bd514acb9166926af9c33b4f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e8234866bd514acb9166926af9c33b4f 2023-02-10 07:56:07,195 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/1dc647d13bf248ec818d6beb47295ee3 2023-02-10 07:56:07,199 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/1dc647d13bf248ec818d6beb47295ee3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/1dc647d13bf248ec818d6beb47295ee3 2023-02-10 07:56:07,202 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/1dc647d13bf248ec818d6beb47295ee3, entries=1, sequenceid=9, filesize=5.0 K 2023-02-10 07:56:07,203 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 825ms, sequenceid=9, compaction requested=false 2023-02-10 07:56:07,203 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:07,203 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,206 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,206 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:07,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:07,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f3b3214[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:07,207 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:07,207 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,208 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:07,208 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,208 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:07,210 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,210 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:07,210 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:07,210 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:07,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:07,212 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:07,212 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:07,212 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:07,212 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,212 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:07,213 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,213 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:07,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,213 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:07,214 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,215 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,217 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,218 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:07,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:07,218 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:07,218 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:07,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:07,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:07,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:56:07,218 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:07,218 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,218 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:07,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:07,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:07,318 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:07,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:07,323 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:07,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:07,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,324 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:07,325 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:07,325 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:07,325 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:07,325 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,325 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,335 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,335 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:07,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:07,335 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:07,335 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:07,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:07,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,336 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,336 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:07,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:07,337 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:07,337 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:07,337 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:07,337 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:07,337 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:07,337 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:07,337 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:07,337 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:56:07,749 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016df2e0c783044dfd85ae153bf894124c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016df2e0c783044dfd85ae153bf894124c 2023-02-10 07:56:08,154 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/26b1e14cd02042bfa6426de6c965d641 2023-02-10 07:56:08,159 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/26b1e14cd02042bfa6426de6c965d641 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/26b1e14cd02042bfa6426de6c965d641 2023-02-10 07:56:08,162 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/26b1e14cd02042bfa6426de6c965d641, entries=1, sequenceid=13, filesize=4.9 K 2023-02-10 07:56:08,163 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 826ms, sequenceid=13, compaction requested=true 2023-02-10 07:56:08,163 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:08,163 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:08,163 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:08,163 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:08,163 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,163 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:08,163 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:08,164 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,164 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:08,165 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,165 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:08,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:08,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@459af636[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:08,166 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:08,166 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,169 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,169 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:08,169 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,169 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:08,169 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:08,169 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:08,170 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:08,170 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,170 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:08,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:08,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:08,170 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:08,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:08,172 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:08,172 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:08,172 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:08,172 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,173 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:08,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:08,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,174 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:08,175 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,176 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:08,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,178 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,178 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:08,178 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:08,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:08,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:08,178 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:08,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:08,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:08,278 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:08,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:08,283 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:08,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:08,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,285 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:08,285 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:08,285 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:08,285 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:08,285 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,285 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,287 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,287 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:08,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:08,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:08,288 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:08,288 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:08,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:08,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,289 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,289 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:08,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:08,289 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:08,289 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:08,289 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:08,289 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:08,289 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:08,289 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:08,289 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:08,289 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:56:08,701 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056333f46c74d74129b3febd55a6b997a3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512056333f46c74d74129b3febd55a6b997a3 2023-02-10 07:56:09,105 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/836786f813064d5d92e6bf8d1e7fee8f 2023-02-10 07:56:09,110 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/836786f813064d5d92e6bf8d1e7fee8f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/836786f813064d5d92e6bf8d1e7fee8f 2023-02-10 07:56:09,113 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/836786f813064d5d92e6bf8d1e7fee8f, entries=1, sequenceid=17, filesize=4.9 K 2023-02-10 07:56:09,114 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 825ms, sequenceid=17, compaction requested=true 2023-02-10 07:56:09,114 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:09,114 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,116 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,116 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:09,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:09,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d0d4f39[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:09,117 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:09,117 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,118 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,118 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,118 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:09,118 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:09,119 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:09,119 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:09,120 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,120 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:09,120 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:09,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:09,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:09,120 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:09,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:09,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:09,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:09,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:09,122 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:09,122 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:09,122 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:09,122 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,122 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:09,125 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,125 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:09,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,125 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:09,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,126 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:09,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,127 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,128 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,128 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,128 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,128 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,128 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:09,128 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:09,128 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:09,129 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:09,128 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,129 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:09,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:56:09,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:09,129 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:09,129 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,129 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:09,129 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:09,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:09,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:09,229 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:09,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:09,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:09,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:09,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,235 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:09,235 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:09,235 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:09,235 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:09,235 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,236 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,237 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,237 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:09,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:09,237 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:09,237 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:09,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:09,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,238 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,238 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:09,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:09,238 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:09,238 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:09,238 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:09,238 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:09,238 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:09,239 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:09,239 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:09,239 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:56:09,649 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122833638e3442ed49a9b55d1854fdfb2bed to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122833638e3442ed49a9b55d1854fdfb2bed 2023-02-10 07:56:09,946 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:56:10,054 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/a25f99da43994751a2efb5e370c64df9 2023-02-10 07:56:10,058 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/a25f99da43994751a2efb5e370c64df9 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a25f99da43994751a2efb5e370c64df9 2023-02-10 07:56:10,062 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a25f99da43994751a2efb5e370c64df9, entries=1, sequenceid=21, filesize=4.9 K 2023-02-10 07:56:10,063 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 824ms, sequenceid=21, compaction requested=true 2023-02-10 07:56:10,063 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:10,063 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:10,063 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:10,063 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:10,064 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,064 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:10,064 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:10,065 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,065 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:10,065 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,065 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:10,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:10,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:10,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35cc09de[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:10,067 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:10,067 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,069 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,069 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:10,069 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:10,069 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:10,069 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,069 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:10,070 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:10,070 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,070 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:10,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:10,070 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:10,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:10,073 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:10,073 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:10,073 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:10,073 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,073 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:10,074 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,074 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,074 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:10,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:10,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:10,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:10,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:10,075 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,076 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:10,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,084 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,084 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:10,084 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:10,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:10,085 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:10,085 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:10,085 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:10,085 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:10,085 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,085 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,085 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,085 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,085 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:10,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:10,085 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:10,085 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:10,185 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:10,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:10,190 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:10,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:10,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,192 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:10,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:10,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:10,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:10,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,192 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,195 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:10,195 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:10,195 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,195 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,196 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,196 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:10,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,196 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:10,196 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:10,196 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:10,196 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:10,196 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:10,196 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:10,196 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:10,196 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:56:10,206 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312c4393ea06f743789f1ecc25b180d7f2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312c4393ea06f743789f1ecc25b180d7f2 2023-02-10 07:56:10,611 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/a01e0e7d2264418e8ce6d43b62e3317b 2023-02-10 07:56:10,615 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/a01e0e7d2264418e8ce6d43b62e3317b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a01e0e7d2264418e8ce6d43b62e3317b 2023-02-10 07:56:10,618 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a01e0e7d2264418e8ce6d43b62e3317b, entries=1, sequenceid=25, filesize=4.9 K 2023-02-10 07:56:10,619 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 423ms, sequenceid=25, compaction requested=true 2023-02-10 07:56:10,619 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:10,619 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:10,619 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:10,620 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,620 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:10,621 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,621 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:10,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:10,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13c136e1[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:10,622 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:10,622 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,623 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:10,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:10,623 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:10,623 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,623 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:10,624 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:10,625 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:10,624 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,625 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:10,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:10,627 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:10,627 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:10,627 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:10,627 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,627 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:10,630 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,630 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:10,630 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:10,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:10,630 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:10,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,631 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,633 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,633 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:10,633 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:10,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:10,633 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:10,633 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:10,633 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:10,634 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:10,634 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,634 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,634 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:56:10,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:10,634 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:10,634 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:10,634 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:10,634 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,734 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:10,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:10,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:10,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:10,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,740 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:10,740 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:10,740 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:10,741 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:10,741 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,741 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,742 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:10,742 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:10,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:10,743 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:10,743 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:10,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:10,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,743 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,743 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:10,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:10,743 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:10,743 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:10,744 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:10,744 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:10,744 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:10,744 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:10,744 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:10,744 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:56:11,156 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019e9c5c081e1f4d49bb3233e55c12b164 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019e9c5c081e1f4d49bb3233e55c12b164 2023-02-10 07:56:11,561 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/ed6097b375244e03a72751f334681a0d 2023-02-10 07:56:11,565 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/ed6097b375244e03a72751f334681a0d as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ed6097b375244e03a72751f334681a0d 2023-02-10 07:56:11,568 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ed6097b375244e03a72751f334681a0d, entries=1, sequenceid=29, filesize=4.9 K 2023-02-10 07:56:11,569 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 825ms, sequenceid=29, compaction requested=true 2023-02-10 07:56:11,569 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:11,569 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:11,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:11,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:11,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:11,569 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:11,571 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:11,571 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,572 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:11,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:11,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17849e9[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:11,573 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:11,573 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,575 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,575 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:11,575 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:11,575 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:11,575 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,575 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:11,576 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:11,576 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:11,576 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,576 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:11,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:11,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:11,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:11,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:11,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:11,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:11,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:11,578 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:11,578 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:11,578 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:11,579 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,579 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:11,580 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,580 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,580 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:11,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:11,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:11,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:11,580 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:11,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:11,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:11,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,581 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:11,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,583 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:11,583 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,583 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:11,583 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:11,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:11,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:11,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:11,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:11,583 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:56:11,584 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,584 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:11,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:11,584 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:11,584 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:11,584 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,584 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,584 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,684 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:11,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:11,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:11,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:11,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,690 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:11,690 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:11,690 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:11,690 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:11,690 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,690 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,692 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,692 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:11,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:11,692 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:11,693 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,693 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,693 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:11,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:11,693 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:11,694 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:11,694 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:11,694 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:11,694 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:11,694 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:11,694 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:11,694 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:56:12,104 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035aa364aa7efe459fb44a848dcf47fda4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601035aa364aa7efe459fb44a848dcf47fda4 2023-02-10 07:56:12,510 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/0c14ac93b0374fedb37a1deaca8f90cf 2023-02-10 07:56:12,513 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/0c14ac93b0374fedb37a1deaca8f90cf as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0c14ac93b0374fedb37a1deaca8f90cf 2023-02-10 07:56:12,517 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0c14ac93b0374fedb37a1deaca8f90cf, entries=1, sequenceid=33, filesize=4.9 K 2023-02-10 07:56:12,518 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 824ms, sequenceid=33, compaction requested=true 2023-02-10 07:56:12,518 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:12,518 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:12,518 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:12,518 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:12,518 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,518 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:12,518 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:12,519 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,519 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:12,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:12,520 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,520 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:12,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:12,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56dbba78[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:12,521 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:12,521 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,522 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:12,522 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,522 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:12,522 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:12,523 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:12,523 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,523 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:12,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:12,523 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:12,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:12,525 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:12,525 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:12,525 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:12,525 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,526 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:12,532 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,532 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,532 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:12,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:12,532 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:12,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,533 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,538 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:12,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:12,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:12,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:12,539 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:12,538 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:12,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:12,639 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:12,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:12,643 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:12,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:12,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,644 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:12,644 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:12,644 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:12,644 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:12,645 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,645 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,646 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:12,646 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:12,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:12,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,647 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:12,647 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:12,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:12,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:12,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:12,647 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:12,647 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:12,648 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:12,648 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:12,648 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:12,648 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:12,648 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:12,648 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:56:13,058 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907888ad6fdc8fc4fb690dde8362536994c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907888ad6fdc8fc4fb690dde8362536994c 2023-02-10 07:56:13,463 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/96d1452deaa54af187fbc1ea8c4cf7c9 2023-02-10 07:56:13,467 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/96d1452deaa54af187fbc1ea8c4cf7c9 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/96d1452deaa54af187fbc1ea8c4cf7c9 2023-02-10 07:56:13,470 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/96d1452deaa54af187fbc1ea8c4cf7c9, entries=1, sequenceid=37, filesize=4.9 K 2023-02-10 07:56:13,471 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 823ms, sequenceid=37, compaction requested=true 2023-02-10 07:56:13,471 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:13,471 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:13,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:13,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:13,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,471 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:13,472 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:13,473 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,473 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:13,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:13,473 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,473 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:13,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:13,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30cdb84[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:13,474 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:13,474 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,475 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,475 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:13,476 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:13,476 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:13,476 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,476 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:13,477 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:13,477 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,477 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:13,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:13,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:13,477 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:13,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:13,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:13,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:13,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:13,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:13,479 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:13,479 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:13,479 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:13,479 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,479 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:13,482 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,482 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,482 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:13,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:13,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:13,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:13,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:13,482 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:13,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:13,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,483 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:13,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,485 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,485 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:13,485 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:13,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:13,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:56:13,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:13,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:13,485 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:13,485 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,485 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:13,485 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,485 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,486 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,486 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,486 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:13,486 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:13,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:13,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:13,586 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:13,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:13,590 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:13,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:13,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,591 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:13,591 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:13,591 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-10 07:56:13,591 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-10 07:56:13,592 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,592 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,593 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,593 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:13,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:13,593 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:13,593 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:13,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,594 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,594 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-10 07:56:13,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:13,594 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-10 07:56:13,594 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:13,594 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-10 07:56:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-10 07:56:13,595 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:13,595 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:13,595 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. started... 2023-02-10 07:56:13,595 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 44f0ab95b846f4a7edff1076e42206be 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-10 07:56:14,005 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112039a93af815504ad7a23acb6063b0624c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112039a93af815504ad7a23acb6063b0624c 2023-02-10 07:56:14,411 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/ff38a1274c3f41618e2d63ed87490473 2023-02-10 07:56:14,414 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/ff38a1274c3f41618e2d63ed87490473 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ff38a1274c3f41618e2d63ed87490473 2023-02-10 07:56:14,417 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ff38a1274c3f41618e2d63ed87490473, entries=1, sequenceid=41, filesize=4.9 K 2023-02-10 07:56:14,417 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 44f0ab95b846f4a7edff1076e42206be in 822ms, sequenceid=41, compaction requested=true 2023-02-10 07:56:14,418 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:14,418 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:14,418 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-10 07:56:14,418 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-10 07:56:14,418 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,418 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-10 07:56:14,418 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-10 07:56:14,420 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,420 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:14,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:14,421 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,421 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:14,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:14,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:14,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-10 07:56:14,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19e0833a[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:14,422 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-10 07:56:14,422 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,423 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,423 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-10 07:56:14,424 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-10 07:56:14,424 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,424 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:14,424 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:14,425 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,425 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-10 07:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:14,425 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:14,425 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-10 07:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:14,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-10 07:56:14,427 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-10 07:56:14,427 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:14,427 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:14,427 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,427 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:14,428 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,428 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:14,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,429 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:14,429 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:14,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,430 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:14,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,433 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-10 07:56:14,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:14,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:14,434 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,434 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,434 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:14,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:14,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:14,434 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:14,535 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:14,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:14,540 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-10 07:56:14,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:56:14,542 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:56:14,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:56:14,542 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016374542 2023-02-10 07:56:14,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-10 07:56:14,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-10 07:56:14,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:56:14,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x7cc05874 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:56:14,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@430d9b01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:56:14,550 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:56:14,976 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cba13f83919a48bc9709f9770f0764e1 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cba13f83919a48bc9709f9770f0764e1 2023-02-10 07:56:14,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:56:14,989 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:56:14,991 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56976, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:56:14,998 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:56:15,000 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:56:15,016 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b51d141521f840db97a55e9ae4e1b5e3 first=Optional[r5] last=Optional[r6] 2023-02-10 07:56:15,017 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b51d141521f840db97a55e9ae4e1b5e3}] 2023-02-10 07:56:15,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b51d141521f840db97a55e9ae4e1b5e3 for inclusion in 44f0ab95b846f4a7edff1076e42206be/family1 2023-02-10 07:56:15,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-10 07:56:15,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:56:15,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:15,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/b51d141521f840db97a55e9ae4e1b5e3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__cfsu5da3thjffi5i2nuktm72cdpj7o5nkia7fsdmdc5qhk6qef1sm9ef7np4onds/family1/b51d141521f840db97a55e9ae4e1b5e3 2023-02-10 07:56:15,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__cfsu5da3thjffi5i2nuktm72cdpj7o5nkia7fsdmdc5qhk6qef1sm9ef7np4onds/family1/b51d141521f840db97a55e9ae4e1b5e3 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0ade5d6d44844615a9dae88a0e09243d_SeqId_44_ 2023-02-10 07:56:15,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__cfsu5da3thjffi5i2nuktm72cdpj7o5nkia7fsdmdc5qhk6qef1sm9ef7np4onds/family1/b51d141521f840db97a55e9ae4e1b5e3 into 44f0ab95b846f4a7edff1076e42206be/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0ade5d6d44844615a9dae88a0e09243d_SeqId_44_ - updating store file list. 2023-02-10 07:56:15,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0ade5d6d44844615a9dae88a0e09243d_SeqId_44_ into 44f0ab95b846f4a7edff1076e42206be/family1 2023-02-10 07:56:15,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__cfsu5da3thjffi5i2nuktm72cdpj7o5nkia7fsdmdc5qhk6qef1sm9ef7np4onds/family1/b51d141521f840db97a55e9ae4e1b5e3 into 44f0ab95b846f4a7edff1076e42206be/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0ade5d6d44844615a9dae88a0e09243d_SeqId_44_) 2023-02-10 07:56:15,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__cfsu5da3thjffi5i2nuktm72cdpj7o5nkia7fsdmdc5qhk6qef1sm9ef7np4onds/family1/b51d141521f840db97a55e9ae4e1b5e3 2023-02-10 07:56:15,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-10 07:56:15,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-10 07:56:15,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 44f0ab95b846f4a7edff1076e42206be/family1 is initiating minor compaction 2023-02-10 07:56:15,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@433fbe58; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:56:15,037 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 44f0ab95b846f4a7edff1076e42206be/family1 in testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:15,037 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/1dc647d13bf248ec818d6beb47295ee3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/26b1e14cd02042bfa6426de6c965d641, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/836786f813064d5d92e6bf8d1e7fee8f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a25f99da43994751a2efb5e370c64df9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a01e0e7d2264418e8ce6d43b62e3317b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ed6097b375244e03a72751f334681a0d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0c14ac93b0374fedb37a1deaca8f90cf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/96d1452deaa54af187fbc1ea8c4cf7c9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ff38a1274c3f41618e2d63ed87490473, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0ade5d6d44844615a9dae88a0e09243d_SeqId_44_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp, totalSize=49.7 K 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 1dc647d13bf248ec818d6beb47295ee3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 26b1e14cd02042bfa6426de6c965d641, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 836786f813064d5d92e6bf8d1e7fee8f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting a25f99da43994751a2efb5e370c64df9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting a01e0e7d2264418e8ce6d43b62e3317b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting ed6097b375244e03a72751f334681a0d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0c14ac93b0374fedb37a1deaca8f90cf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 96d1452deaa54af187fbc1ea8c4cf7c9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting ff38a1274c3f41618e2d63ed87490473, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-10 07:56:15,037 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0ade5d6d44844615a9dae88a0e09243d_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-10 07:56:15,039 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:56:15,040 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:15,041 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019e9c5c081e1f4d49bb3233e55c12b164 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601019e9c5c081e1f4d49bb3233e55c12b164 2023-02-10 07:56:15,043 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601035aa364aa7efe459fb44a848dcf47fda4 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601035aa364aa7efe459fb44a848dcf47fda4 2023-02-10 07:56:15,043 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-10 07:56:15,043 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-10 07:56:15,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:56:15,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:56:15,068 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 44f0ab95b846f4a7edff1076e42206be#family1#compaction#166 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:15,490 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/a9f8ef7044994690af52c7ac5dad0804 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a9f8ef7044994690af52c7ac5dad0804 2023-02-10 07:56:15,493 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315c607d6ebe074bc388b38f1a0a3c68bd to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315c607d6ebe074bc388b38f1a0a3c68bd 2023-02-10 07:56:15,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:56:15,497 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 44f0ab95b846f4a7edff1076e42206be/family1 of 44f0ab95b846f4a7edff1076e42206be into a9f8ef7044994690af52c7ac5dad0804(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:56:15,497 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:15,497 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676015775036; duration=0sec 2023-02-10 07:56:15,498 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:56:15,516 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bd13cf88ccea48e18ec3083d41efaeb8 first=Optional[r1] last=Optional[r4] 2023-02-10 07:56:15,516 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bd13cf88ccea48e18ec3083d41efaeb8}] 2023-02-10 07:56:15,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bd13cf88ccea48e18ec3083d41efaeb8 for inclusion in 44f0ab95b846f4a7edff1076e42206be/family1 2023-02-10 07:56:15,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-10 07:56:15,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:56:15,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:15,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bd13cf88ccea48e18ec3083d41efaeb8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qppjth6oqrjb8rj9kbpe9oo8qqcseo40lfk1rp62hign49f01thme18ivor1eeos/family1/bd13cf88ccea48e18ec3083d41efaeb8 2023-02-10 07:56:15,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qppjth6oqrjb8rj9kbpe9oo8qqcseo40lfk1rp62hign49f01thme18ivor1eeos/family1/bd13cf88ccea48e18ec3083d41efaeb8 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_ 2023-02-10 07:56:15,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qppjth6oqrjb8rj9kbpe9oo8qqcseo40lfk1rp62hign49f01thme18ivor1eeos/family1/bd13cf88ccea48e18ec3083d41efaeb8 into 44f0ab95b846f4a7edff1076e42206be/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_ - updating store file list. 2023-02-10 07:56:15,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_ into 44f0ab95b846f4a7edff1076e42206be/family1 2023-02-10 07:56:15,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qppjth6oqrjb8rj9kbpe9oo8qqcseo40lfk1rp62hign49f01thme18ivor1eeos/family1/bd13cf88ccea48e18ec3083d41efaeb8 into 44f0ab95b846f4a7edff1076e42206be/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_) 2023-02-10 07:56:15,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qppjth6oqrjb8rj9kbpe9oo8qqcseo40lfk1rp62hign49f01thme18ivor1eeos/family1/bd13cf88ccea48e18ec3083d41efaeb8 2023-02-10 07:56:15,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-10 07:56:15,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-10 07:56:15,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 44f0ab95b846f4a7edff1076e42206be/family1 is initiating minor compaction (all files) 2023-02-10 07:56:15,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4f3ca291; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:56:15,527 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 44f0ab95b846f4a7edff1076e42206be/family1 in testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:15,527 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/f6a711a0484c43a0be153a93ce9f0acb, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a9f8ef7044994690af52c7ac5dad0804, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp, totalSize=178.1 K 2023-02-10 07:56:15,527 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting f6a711a0484c43a0be153a93ce9f0acb, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878842896 2023-02-10 07:56:15,528 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting a9f8ef7044994690af52c7ac5dad0804, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621242896 2023-02-10 07:56:15,528 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] compactions.Compactor(207): Compacting 13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965242896 2023-02-10 07:56:15,529 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:56:15,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:15,532 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016df2e0c783044dfd85ae153bf894124c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016df2e0c783044dfd85ae153bf894124c 2023-02-10 07:56:15,533 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512056333f46c74d74129b3febd55a6b997a3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512056333f46c74d74129b3febd55a6b997a3 2023-02-10 07:56:15,534 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122833638e3442ed49a9b55d1854fdfb2bed to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122833638e3442ed49a9b55d1854fdfb2bed 2023-02-10 07:56:15,535 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312c4393ea06f743789f1ecc25b180d7f2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512312c4393ea06f743789f1ecc25b180d7f2 2023-02-10 07:56:15,536 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-10 07:56:15,536 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-10 07:56:15,536 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:56:15,536 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:56:15,540 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 44f0ab95b846f4a7edff1076e42206be#family1#compaction#167 average throughput is 25.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:15,562 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/.tmp/family1/0bd81f23d5f74a18942d02dc3272f259 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0bd81f23d5f74a18942d02dc3272f259 2023-02-10 07:56:15,566 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 44f0ab95b846f4a7edff1076e42206be/family1 of 44f0ab95b846f4a7edff1076e42206be into 0bd81f23d5f74a18942d02dc3272f259(size=167.7 K), total size for store is 167.7 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:56:15,566 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:15,566 INFO [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676015775527; duration=0sec 2023-02-10 07:56:15,566 DEBUG [RS:0;jenkins-hbase4:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-10 07:56:15,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/f6a711a0484c43a0be153a93ce9f0acb, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/1dc647d13bf248ec818d6beb47295ee3, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/26b1e14cd02042bfa6426de6c965d641, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/836786f813064d5d92e6bf8d1e7fee8f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a25f99da43994751a2efb5e370c64df9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a01e0e7d2264418e8ce6d43b62e3317b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ed6097b375244e03a72751f334681a0d, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0c14ac93b0374fedb37a1deaca8f90cf, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/96d1452deaa54af187fbc1ea8c4cf7c9, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ff38a1274c3f41618e2d63ed87490473, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a9f8ef7044994690af52c7ac5dad0804, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0ade5d6d44844615a9dae88a0e09243d_SeqId_44_, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_] to archive 2023-02-10 07:56:15,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:15,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/f6a711a0484c43a0be153a93ce9f0acb to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/f6a711a0484c43a0be153a93ce9f0acb 2023-02-10 07:56:15,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/1dc647d13bf248ec818d6beb47295ee3 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/1dc647d13bf248ec818d6beb47295ee3 2023-02-10 07:56:15,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/26b1e14cd02042bfa6426de6c965d641 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/26b1e14cd02042bfa6426de6c965d641 2023-02-10 07:56:15,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/836786f813064d5d92e6bf8d1e7fee8f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/836786f813064d5d92e6bf8d1e7fee8f 2023-02-10 07:56:15,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a25f99da43994751a2efb5e370c64df9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a25f99da43994751a2efb5e370c64df9 2023-02-10 07:56:15,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a01e0e7d2264418e8ce6d43b62e3317b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a01e0e7d2264418e8ce6d43b62e3317b 2023-02-10 07:56:15,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ed6097b375244e03a72751f334681a0d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ed6097b375244e03a72751f334681a0d 2023-02-10 07:56:15,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0c14ac93b0374fedb37a1deaca8f90cf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0c14ac93b0374fedb37a1deaca8f90cf 2023-02-10 07:56:15,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/96d1452deaa54af187fbc1ea8c4cf7c9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/96d1452deaa54af187fbc1ea8c4cf7c9 2023-02-10 07:56:15,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ff38a1274c3f41618e2d63ed87490473 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/ff38a1274c3f41618e2d63ed87490473 2023-02-10 07:56:15,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a9f8ef7044994690af52c7ac5dad0804 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/a9f8ef7044994690af52c7ac5dad0804 2023-02-10 07:56:15,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0ade5d6d44844615a9dae88a0e09243d_SeqId_44_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/0ade5d6d44844615a9dae88a0e09243d_SeqId_44_ 2023-02-10 07:56:15,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_ to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/13c9e137e46f4bf7b7e07f3a485546cd_SeqId_47_ 2023-02-10 07:56:16,377 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307f275d12ed9f4bcfb71b6e0df882488d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307f275d12ed9f4bcfb71b6e0df882488d 2023-02-10 07:56:16,378 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:56:16,400 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a526ec235e21488a8274fd0685b251de first=Optional[r00] last=Optional[r8] 2023-02-10 07:56:16,401 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a526ec235e21488a8274fd0685b251de}] 2023-02-10 07:56:16,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a526ec235e21488a8274fd0685b251de for inclusion in 44f0ab95b846f4a7edff1076e42206be/family1 2023-02-10 07:56:16,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-10 07:56:16,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-10 07:56:16,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 44f0ab95b846f4a7edff1076e42206be: 2023-02-10 07:56:16,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a526ec235e21488a8274fd0685b251de to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__32qdqv5d61lurqla37rcdgr1o8h33dohdme0kvjprrh6pn2fjknlpp2i46kbk58q/family1/a526ec235e21488a8274fd0685b251de 2023-02-10 07:56:16,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__32qdqv5d61lurqla37rcdgr1o8h33dohdme0kvjprrh6pn2fjknlpp2i46kbk58q/family1/a526ec235e21488a8274fd0685b251de as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/e17de96b9d984520b442c201008e80cf_SeqId_50_ 2023-02-10 07:56:16,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__32qdqv5d61lurqla37rcdgr1o8h33dohdme0kvjprrh6pn2fjknlpp2i46kbk58q/family1/a526ec235e21488a8274fd0685b251de into 44f0ab95b846f4a7edff1076e42206be/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/e17de96b9d984520b442c201008e80cf_SeqId_50_ - updating store file list. 2023-02-10 07:56:16,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/e17de96b9d984520b442c201008e80cf_SeqId_50_ into 44f0ab95b846f4a7edff1076e42206be/family1 2023-02-10 07:56:16,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__32qdqv5d61lurqla37rcdgr1o8h33dohdme0kvjprrh6pn2fjknlpp2i46kbk58q/family1/a526ec235e21488a8274fd0685b251de into 44f0ab95b846f4a7edff1076e42206be/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/family1/e17de96b9d984520b442c201008e80cf_SeqId_50_) 2023-02-10 07:56:16,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMinorCompactionWithMonthlyPolicy__32qdqv5d61lurqla37rcdgr1o8h33dohdme0kvjprrh6pn2fjknlpp2i46kbk58q/family1/a526ec235e21488a8274fd0685b251de 2023-02-10 07:56:16,412 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:56:16,413 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:16,414 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112039a93af815504ad7a23acb6063b0624c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112039a93af815504ad7a23acb6063b0624c 2023-02-10 07:56:16,415 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e8234866bd514acb9166926af9c33b4f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128e8234866bd514acb9166926af9c33b4f 2023-02-10 07:56:16,416 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113041e998450eae4d79b38e07e983c41e6e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113041e998450eae4d79b38e07e983c41e6e 2023-02-10 07:56:16,416 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-10 07:56:16,416 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-10 07:56:16,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:56:16,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:56:16,416 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-10 07:56:16,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-10 07:56:16,416 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:56:16,418 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-10 07:56:16,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8780 sec 2023-02-10 07:56:16,537 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=252 (was 248) - Thread LEAK? -, OpenFileDescriptor=644 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=122 (was 120) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3459 (was 3337) - AvailableMemoryMB LEAK? - 2023-02-10 07:56:16,548 INFO [Listener at localhost/46793] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=252, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=122, ProcessCount=168, AvailableMemoryMB=3459 2023-02-10 07:56:16,567 DEBUG [Listener at localhost/46793] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-10 07:56:16,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF7\xBE\x05\xF2\xC4sp\xE1H\x0E\xAA\xB7\xDCS\x14E"\x10\xD4k\x97\xD1\x8DZ\x13\xBC\xB3\x82SE\x0F\x976\xA2*\x10j\xA5p\xC1b\xCC2n\x94\xEC\xB4\x0A\xF9\xB4I\xB42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-10 07:56:16,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-10 07:56:16,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-10 07:56:16,623 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-10 07:56:16,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-10 07:56:16,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-10 07:56:16,625 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:16,625 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:16,626 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7 2023-02-10 07:56:16,626 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf empty. 2023-02-10 07:56:16,626 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6 empty. 2023-02-10 07:56:16,626 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7 empty. 2023-02-10 07:56:16,626 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:16,626 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7 2023-02-10 07:56:16,626 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:16,626 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-10 07:56:16,635 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-10 07:56:16,637 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 66779501625c4d811545b82be075e6d7, NAME => 'testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF7\xBE\x05\xF2\xC4sp\xE1H\x0E\xAA\xB7\xDCS\x14E"\x10\xD4k\x97\xD1\x8DZ\x13\xBC\xB3\x82SE\x0F\x976\xA2*\x10j\xA5p\xC1b\xCC2n\x94\xEC\xB4\x0A\xF9\xB4I\xB42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:56:16,637 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9c0f413ca7d85905c75919d7ff6ff1cf, NAME => 'testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF7\xBE\x05\xF2\xC4sp\xE1H\x0E\xAA\xB7\xDCS\x14E"\x10\xD4k\x97\xD1\x8DZ\x13\xBC\xB3\x82SE\x0F\x976\xA2*\x10j\xA5p\xC1b\xCC2n\x94\xEC\xB4\x0A\xF9\xB4I\xB42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:56:16,637 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1899ad3844609850cfa35d2451de0de6, NAME => 'testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF7\xBE\x05\xF2\xC4sp\xE1H\x0E\xAA\xB7\xDCS\x14E"\x10\xD4k\x97\xD1\x8DZ\x13\xBC\xB3\x82SE\x0F\x976\xA2*\x10j\xA5p\xC1b\xCC2n\x94\xEC\xB4\x0A\xF9\xB4I\xB42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/.tmp 2023-02-10 07:56:16,648 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:56:16,648 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 66779501625c4d811545b82be075e6d7, disabling compactions & flushes 2023-02-10 07:56:16,648 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:16,649 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:16,649 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. after waiting 0 ms 2023-02-10 07:56:16,649 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:16,649 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:16,649 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 66779501625c4d811545b82be075e6d7: Waiting for close lock at 1676015776648Disabling compacts and flushes for region at 1676015776648Disabling writes for close at 1676015776649 (+1 ms)Writing region close event to WAL at 1676015776649Closed at 1676015776649 2023-02-10 07:56:16,650 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:56:16,650 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 9c0f413ca7d85905c75919d7ff6ff1cf, disabling compactions & flushes 2023-02-10 07:56:16,650 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:16,650 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:16,650 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. after waiting 0 ms 2023-02-10 07:56:16,650 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:16,650 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:16,650 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 9c0f413ca7d85905c75919d7ff6ff1cf: Waiting for close lock at 1676015776650Disabling compacts and flushes for region at 1676015776650Disabling writes for close at 1676015776650Writing region close event to WAL at 1676015776650Closed at 1676015776650 2023-02-10 07:56:16,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-10 07:56:16,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-10 07:56:17,050 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:56:17,051 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 1899ad3844609850cfa35d2451de0de6, disabling compactions & flushes 2023-02-10 07:56:17,051 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:17,051 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:17,051 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. after waiting 0 ms 2023-02-10 07:56:17,051 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:17,051 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:17,051 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 1899ad3844609850cfa35d2451de0de6: Waiting for close lock at 1676015777051Disabling compacts and flushes for region at 1676015777051Disabling writes for close at 1676015777051Writing region close event to WAL at 1676015777051Closed at 1676015777051 2023-02-10 07:56:17,053 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-10 07:56:17,054 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015777054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015777054"}]},"ts":"1676015777054"} 2023-02-10 07:56:17,054 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015777054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015777054"}]},"ts":"1676015777054"} 2023-02-10 07:56:17,054 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676015777054"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676015777054"}]},"ts":"1676015777054"} 2023-02-10 07:56:17,056 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-10 07:56:17,056 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-10 07:56:17,057 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015777057"}]},"ts":"1676015777057"} 2023-02-10 07:56:17,058 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-10 07:56:17,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9c0f413ca7d85905c75919d7ff6ff1cf, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1899ad3844609850cfa35d2451de0de6, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=66779501625c4d811545b82be075e6d7, ASSIGN}] 2023-02-10 07:56:17,063 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=66779501625c4d811545b82be075e6d7, ASSIGN 2023-02-10 07:56:17,063 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1899ad3844609850cfa35d2451de0de6, ASSIGN 2023-02-10 07:56:17,063 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9c0f413ca7d85905c75919d7ff6ff1cf, ASSIGN 2023-02-10 07:56:17,063 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=66779501625c4d811545b82be075e6d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:56:17,063 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1899ad3844609850cfa35d2451de0de6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:56:17,063 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9c0f413ca7d85905c75919d7ff6ff1cf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36907,1676015618909; forceNewPlan=false, retain=false 2023-02-10 07:56:17,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=9c0f413ca7d85905c75919d7ff6ff1cf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:17,215 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=1899ad3844609850cfa35d2451de0de6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:17,215 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015777215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015777215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015777215"}]},"ts":"1676015777215"} 2023-02-10 07:56:17,215 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=66779501625c4d811545b82be075e6d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:17,215 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676015777215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015777215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015777215"}]},"ts":"1676015777215"} 2023-02-10 07:56:17,215 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015777215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676015777215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676015777215"}]},"ts":"1676015777215"} 2023-02-10 07:56:17,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 9c0f413ca7d85905c75919d7ff6ff1cf, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:56:17,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 66779501625c4d811545b82be075e6d7, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:56:17,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 1899ad3844609850cfa35d2451de0de6, server=jenkins-hbase4.apache.org,36907,1676015618909}] 2023-02-10 07:56:17,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-10 07:56:17,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:17,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c0f413ca7d85905c75919d7ff6ff1cf, NAME => 'testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf.', STARTKEY => '', ENDKEY => '1'} 2023-02-10 07:56:17,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:17,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:56:17,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:17,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:17,393 INFO [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:17,394 DEBUG [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1 2023-02-10 07:56:17,394 DEBUG [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1 2023-02-10 07:56:17,395 INFO [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c0f413ca7d85905c75919d7ff6ff1cf columnFamilyName family1 2023-02-10 07:56:17,396 INFO [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] regionserver.HStore(310): Store=9c0f413ca7d85905c75919d7ff6ff1cf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:56:17,396 INFO [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:17,397 DEBUG [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2 2023-02-10 07:56:17,397 DEBUG [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2 2023-02-10 07:56:17,397 INFO [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c0f413ca7d85905c75919d7ff6ff1cf columnFamilyName family2 2023-02-10 07:56:17,398 INFO [StoreOpener-9c0f413ca7d85905c75919d7ff6ff1cf-1] regionserver.HStore(310): Store=9c0f413ca7d85905c75919d7ff6ff1cf/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:56:17,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:17,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:17,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:56:17,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:17,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:56:17,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9c0f413ca7d85905c75919d7ff6ff1cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68836118, jitterRate=0.02573809027671814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:56:17,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9c0f413ca7d85905c75919d7ff6ff1cf: Running coprocessor pre-open hook at 1676015777371Writing region info on filesystem at 1676015777371Initializing all the Stores at 1676015777372 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF7\xBE\x05\xF2\xC4sp\xE1H\x0E\xAA\xB7\xDCS\x14E"\x10\xD4k\x97\xD1\x8DZ\x13\xBC\xB3\x82SE\x0F\x976\xA2*\x10j\xA5p\xC1b\xCC2n\x94\xEC\xB4\x0A\xF9\xB4I\xB42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015777372Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015777372Cleaning up temporary data from old regions at 1676015777400 (+28 ms)Cleaning up detritus from prior splits at 1676015777400Running coprocessor post-open hooks at 1676015777403 (+3 ms)Region opened successfully at 1676015777403 2023-02-10 07:56:17,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf., pid=120, masterSystemTime=1676015777368 2023-02-10 07:56:17,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:17,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:17,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:17,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 66779501625c4d811545b82be075e6d7, NAME => 'testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7.', STARTKEY => '2', ENDKEY => ''} 2023-02-10 07:56:17,406 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=9c0f413ca7d85905c75919d7ff6ff1cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:17,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 66779501625c4d811545b82be075e6d7 2023-02-10 07:56:17,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:56:17,406 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015777406"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015777406"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015777406"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015777406"}]},"ts":"1676015777406"} 2023-02-10 07:56:17,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 66779501625c4d811545b82be075e6d7 2023-02-10 07:56:17,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 66779501625c4d811545b82be075e6d7 2023-02-10 07:56:17,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-10 07:56:17,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 9c0f413ca7d85905c75919d7ff6ff1cf, server=jenkins-hbase4.apache.org,36907,1676015618909 in 190 msec 2023-02-10 07:56:17,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9c0f413ca7d85905c75919d7ff6ff1cf, ASSIGN in 348 msec 2023-02-10 07:56:17,427 INFO [StoreOpener-66779501625c4d811545b82be075e6d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 66779501625c4d811545b82be075e6d7 2023-02-10 07:56:17,428 DEBUG [StoreOpener-66779501625c4d811545b82be075e6d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1 2023-02-10 07:56:17,428 DEBUG [StoreOpener-66779501625c4d811545b82be075e6d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1 2023-02-10 07:56:17,428 INFO [StoreOpener-66779501625c4d811545b82be075e6d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66779501625c4d811545b82be075e6d7 columnFamilyName family1 2023-02-10 07:56:17,429 INFO [StoreOpener-66779501625c4d811545b82be075e6d7-1] regionserver.HStore(310): Store=66779501625c4d811545b82be075e6d7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:56:17,429 INFO [StoreOpener-66779501625c4d811545b82be075e6d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 66779501625c4d811545b82be075e6d7 2023-02-10 07:56:17,430 DEBUG [StoreOpener-66779501625c4d811545b82be075e6d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2 2023-02-10 07:56:17,430 DEBUG [StoreOpener-66779501625c4d811545b82be075e6d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2 2023-02-10 07:56:17,430 INFO [StoreOpener-66779501625c4d811545b82be075e6d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66779501625c4d811545b82be075e6d7 columnFamilyName family2 2023-02-10 07:56:17,431 INFO [StoreOpener-66779501625c4d811545b82be075e6d7-1] regionserver.HStore(310): Store=66779501625c4d811545b82be075e6d7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:56:17,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7 2023-02-10 07:56:17,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7 2023-02-10 07:56:17,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:56:17,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 66779501625c4d811545b82be075e6d7 2023-02-10 07:56:17,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:56:17,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 66779501625c4d811545b82be075e6d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67584867, jitterRate=0.007092997431755066}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:56:17,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 66779501625c4d811545b82be075e6d7: Running coprocessor pre-open hook at 1676015777406Writing region info on filesystem at 1676015777406Initializing all the Stores at 1676015777407 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF7\xBE\x05\xF2\xC4sp\xE1H\x0E\xAA\xB7\xDCS\x14E"\x10\xD4k\x97\xD1\x8DZ\x13\xBC\xB3\x82SE\x0F\x976\xA2*\x10j\xA5p\xC1b\xCC2n\x94\xEC\xB4\x0A\xF9\xB4I\xB42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015777407Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015777407Cleaning up temporary data from old regions at 1676015777432 (+25 ms)Cleaning up detritus from prior splits at 1676015777433 (+1 ms)Running coprocessor post-open hooks at 1676015777436 (+3 ms)Region opened successfully at 1676015777436 2023-02-10 07:56:17,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7., pid=121, masterSystemTime=1676015777368 2023-02-10 07:56:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:17,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:17,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1899ad3844609850cfa35d2451de0de6, NAME => 'testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6.', STARTKEY => '1', ENDKEY => '2'} 2023-02-10 07:56:17,438 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=66779501625c4d811545b82be075e6d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-10 07:56:17,438 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676015777438"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015777438"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015777438"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015777438"}]},"ts":"1676015777438"} 2023-02-10 07:56:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:17,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-02-10 07:56:17,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 66779501625c4d811545b82be075e6d7, server=jenkins-hbase4.apache.org,36907,1676015618909 in 222 msec 2023-02-10 07:56:17,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=66779501625c4d811545b82be075e6d7, ASSIGN in 379 msec 2023-02-10 07:56:17,458 INFO [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:17,460 DEBUG [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1 2023-02-10 07:56:17,460 DEBUG [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1 2023-02-10 07:56:17,460 INFO [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1899ad3844609850cfa35d2451de0de6 columnFamilyName family1 2023-02-10 07:56:17,461 INFO [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] regionserver.HStore(310): Store=1899ad3844609850cfa35d2451de0de6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:56:17,461 INFO [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:17,462 DEBUG [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2 2023-02-10 07:56:17,462 DEBUG [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2 2023-02-10 07:56:17,462 INFO [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1899ad3844609850cfa35d2451de0de6 columnFamilyName family2 2023-02-10 07:56:17,463 INFO [StoreOpener-1899ad3844609850cfa35d2451de0de6-1] regionserver.HStore(310): Store=1899ad3844609850cfa35d2451de0de6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-10 07:56:17,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:17,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:17,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-10 07:56:17,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:17,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-10 07:56:17,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1899ad3844609850cfa35d2451de0de6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70426384, jitterRate=0.04943490028381348}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-10 07:56:17,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1899ad3844609850cfa35d2451de0de6: Running coprocessor pre-open hook at 1676015777438Writing region info on filesystem at 1676015777438Initializing all the Stores at 1676015777439 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF7\xBE\x05\xF2\xC4sp\xE1H\x0E\xAA\xB7\xDCS\x14E"\x10\xD4k\x97\xD1\x8DZ\x13\xBC\xB3\x82SE\x0F\x976\xA2*\x10j\xA5p\xC1b\xCC2n\x94\xEC\xB4\x0A\xF9\xB4I\xB42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015777439Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676015777439Cleaning up temporary data from old regions at 1676015777464 (+25 ms)Cleaning up detritus from prior splits at 1676015777464Running coprocessor post-open hooks at 1676015777467 (+3 ms)Region opened successfully at 1676015777467 2023-02-10 07:56:17,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6., pid=122, masterSystemTime=1676015777368 2023-02-10 07:56:17,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:17,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:17,469 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=1899ad3844609850cfa35d2451de0de6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:17,469 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676015777469"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676015777469"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676015777469"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676015777469"}]},"ts":"1676015777469"} 2023-02-10 07:56:17,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-02-10 07:56:17,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 1899ad3844609850cfa35d2451de0de6, server=jenkins-hbase4.apache.org,36907,1676015618909 in 252 msec 2023-02-10 07:56:17,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-02-10 07:56:17,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1899ad3844609850cfa35d2451de0de6, ASSIGN in 410 msec 2023-02-10 07:56:17,472 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-10 07:56:17,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676015777472"}]},"ts":"1676015777472"} 2023-02-10 07:56:17,473 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-10 07:56:17,475 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-10 07:56:17,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 854 msec 2023-02-10 07:56:17,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-10 07:56:17,728 INFO [Listener at localhost/46793] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-10 07:56:17,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:17,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:17,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:17,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:17,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-10 07:56:17,739 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-10 07:56:17,739 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:17,739 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-10 07:56:17,739 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-10 07:56:17,739 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:17,739 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:17,743 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:17,743 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:17,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:17,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:17,743 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:17,744 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:17,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:17,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:17,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:17,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:17,744 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-10 07:56:17,744 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-10 07:56:17,744 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-10 07:56:17,744 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:17,744 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-10 07:56:17,745 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:56:17,745 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:17,745 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:17,745 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. started... 2023-02-10 07:56:17,745 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. started... 2023-02-10 07:56:17,745 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:17,745 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:17,746 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. started... 2023-02-10 07:56:17,746 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c0f413ca7d85905c75919d7ff6ff1cf 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:56:17,746 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1899ad3844609850cfa35d2451de0de6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:56:17,747 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 66779501625c4d811545b82be075e6d7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-10 07:56:18,190 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021018d03f12dd8c478e9a1b40ad82e0d47a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021018d03f12dd8c478e9a1b40ad82e0d47a 2023-02-10 07:56:18,195 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021017e0875291044383b9360d33ca3c52fd to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021017e0875291044383b9360d33ca3c52fd 2023-02-10 07:56:18,195 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210ace4eeeb93fd4850a66c10b100d38cb2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230210ace4eeeb93fd4850a66c10b100d38cb2 2023-02-10 07:56:18,207 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/74469af1f3e54206a246be0167f50443 2023-02-10 07:56:18,208 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/d0875cc5a56e442b9837195db95bd6b5 2023-02-10 07:56:18,215 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/d2df504616794d5fa91c288f3de62105 2023-02-10 07:56:18,252 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210bd6768d99cd94296ad070f38afd180e9 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230210bd6768d99cd94296ad070f38afd180e9 2023-02-10 07:56:18,648 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302100a16db0e7a764752a13b27924fb8efa5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302100a16db0e7a764752a13b27924fb8efa5 2023-02-10 07:56:18,648 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210b0117d27b72842b78bf307f8c6f066ae to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230210b0117d27b72842b78bf307f8c6f066ae 2023-02-10 07:56:18,653 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/cb5a07cc80d840eda43fdf59df79782f 2023-02-10 07:56:18,656 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/5e485b46a94b4dc2a9c00fae29c682eb 2023-02-10 07:56:18,656 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/d0875cc5a56e442b9837195db95bd6b5 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/d0875cc5a56e442b9837195db95bd6b5 2023-02-10 07:56:18,659 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/d2df504616794d5fa91c288f3de62105 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/d2df504616794d5fa91c288f3de62105 2023-02-10 07:56:18,688 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/d0875cc5a56e442b9837195db95bd6b5, entries=4, sequenceid=5, filesize=5.5 K 2023-02-10 07:56:18,690 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/cb5a07cc80d840eda43fdf59df79782f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/cb5a07cc80d840eda43fdf59df79782f 2023-02-10 07:56:18,690 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/d2df504616794d5fa91c288f3de62105, entries=4, sequenceid=5, filesize=5.5 K 2023-02-10 07:56:18,691 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/5e485b46a94b4dc2a9c00fae29c682eb as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/5e485b46a94b4dc2a9c00fae29c682eb 2023-02-10 07:56:18,693 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/cb5a07cc80d840eda43fdf59df79782f, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:56:18,694 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1899ad3844609850cfa35d2451de0de6 in 948ms, sequenceid=5, compaction requested=false 2023-02-10 07:56:18,694 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-10 07:56:18,694 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/5e485b46a94b4dc2a9c00fae29c682eb, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:56:18,695 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1899ad3844609850cfa35d2451de0de6: 2023-02-10 07:56:18,695 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:56:18,696 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9c0f413ca7d85905c75919d7ff6ff1cf in 950ms, sequenceid=5, compaction requested=false 2023-02-10 07:56:18,696 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c0f413ca7d85905c75919d7ff6ff1cf: 2023-02-10 07:56:18,697 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:56:19,053 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/241856c4c5c14b8aacbedc5e15052148 2023-02-10 07:56:19,057 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/74469af1f3e54206a246be0167f50443 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/74469af1f3e54206a246be0167f50443 2023-02-10 07:56:19,080 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/74469af1f3e54206a246be0167f50443, entries=4, sequenceid=5, filesize=5.5 K 2023-02-10 07:56:19,081 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/241856c4c5c14b8aacbedc5e15052148 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/241856c4c5c14b8aacbedc5e15052148 2023-02-10 07:56:19,084 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/241856c4c5c14b8aacbedc5e15052148, entries=2, sequenceid=5, filesize=5.1 K 2023-02-10 07:56:19,085 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 66779501625c4d811545b82be075e6d7 in 1338ms, sequenceid=5, compaction requested=false 2023-02-10 07:56:19,085 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 66779501625c4d811545b82be075e6d7: 2023-02-10 07:56:19,085 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:19,085 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:56:19,085 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:56:19,085 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,085 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-10 07:56:19,085 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-10 07:56:19,086 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:19,086 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:19,087 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-10 07:56:19,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a14b6ee[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:19,088 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-10 07:56:19,088 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:19,089 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:19,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:19,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-10 07:56:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-10 07:56:19,089 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,089 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:19,089 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-10 07:56:19,091 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:19,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:19,091 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-10 07:56:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:19,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-10 07:56:19,093 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-10 07:56:19,094 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:19,094 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:19,094 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-10 07:56:19,094 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:19,095 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,095 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:19,095 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:19,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:19,096 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:19,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:19,097 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:19,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:19,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,099 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:19,099 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-10 07:56:19,099 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:19,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:19,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:19,099 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:19,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:19,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:19,200 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:19,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:19,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:19,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:19,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:19,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:19,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:19,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-10 07:56:19,206 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-10 07:56:19,206 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:19,206 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-10 07:56:19,206 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-10 07:56:19,206 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,206 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:19,207 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,207 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:19,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:19,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:19,208 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:19,208 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:19,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:19,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:19,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:19,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:19,208 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-10 07:56:19,209 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-10 07:56:19,209 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-10 07:56:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-10 07:56:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-10 07:56:19,209 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:19,209 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. started... 2023-02-10 07:56:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:56:19,209 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:19,209 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 66779501625c4d811545b82be075e6d7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:56:19,209 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:19,209 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. started... 2023-02-10 07:56:19,209 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:19,209 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. started... 2023-02-10 07:56:19,210 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1899ad3844609850cfa35d2451de0de6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:56:19,210 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c0f413ca7d85905c75919d7ff6ff1cf 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-10 07:56:19,253 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210b659e736866548c6a2785c377df3ea99 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210b659e736866548c6a2785c377df3ea99 2023-02-10 07:56:19,267 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/96925d671bc54c24975ed100d738d03b 2023-02-10 07:56:19,267 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021049f9038602e44f4097d5003b8d0f931c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021049f9038602e44f4097d5003b8d0f931c 2023-02-10 07:56:19,299 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021002bab4f5d60a4ac88a9d3db099979c03 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021002bab4f5d60a4ac88a9d3db099979c03 2023-02-10 07:56:19,652 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021006afeb4301a64d599db57e8ffb5031cc to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021006afeb4301a64d599db57e8ffb5031cc 2023-02-10 07:56:19,685 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/c404d11482b94d1b9325fec13f3f621f 2023-02-10 07:56:19,704 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/6d5de4f2dfb24a8786a1439ab79a8461 2023-02-10 07:56:19,708 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/96925d671bc54c24975ed100d738d03b as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/96925d671bc54c24975ed100d738d03b 2023-02-10 07:56:19,742 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/96925d671bc54c24975ed100d738d03b, entries=4, sequenceid=9, filesize=5.5 K 2023-02-10 07:56:19,743 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/6d5de4f2dfb24a8786a1439ab79a8461 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/6d5de4f2dfb24a8786a1439ab79a8461 2023-02-10 07:56:19,746 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/6d5de4f2dfb24a8786a1439ab79a8461, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:56:19,747 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1899ad3844609850cfa35d2451de0de6 in 537ms, sequenceid=9, compaction requested=false 2023-02-10 07:56:19,747 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1899ad3844609850cfa35d2451de0de6: 2023-02-10 07:56:19,747 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:19,748 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:56:20,066 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/35b5f053a59d4a34890a5bd18fc9b659 2023-02-10 07:56:20,133 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302109f5bd8a9e8b84ecdbb0abca154782421 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302109f5bd8a9e8b84ecdbb0abca154782421 2023-02-10 07:56:20,498 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021058cb419e55014da4b0454326c824d326 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021058cb419e55014da4b0454326c824d326 2023-02-10 07:56:20,537 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/fab5de90b1bb4a9b960f4bf08579e53e 2023-02-10 07:56:20,541 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/c404d11482b94d1b9325fec13f3f621f as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/c404d11482b94d1b9325fec13f3f621f 2023-02-10 07:56:20,571 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/c404d11482b94d1b9325fec13f3f621f, entries=4, sequenceid=9, filesize=5.5 K 2023-02-10 07:56:20,572 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/fab5de90b1bb4a9b960f4bf08579e53e as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/fab5de90b1bb4a9b960f4bf08579e53e 2023-02-10 07:56:20,576 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/fab5de90b1bb4a9b960f4bf08579e53e, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:56:20,577 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9c0f413ca7d85905c75919d7ff6ff1cf in 1367ms, sequenceid=9, compaction requested=false 2023-02-10 07:56:20,577 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c0f413ca7d85905c75919d7ff6ff1cf: 2023-02-10 07:56:20,577 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:20,577 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:56:20,903 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/b509bb1a6e2b47d88bf8d047cd935fc7 2023-02-10 07:56:20,907 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/35b5f053a59d4a34890a5bd18fc9b659 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/35b5f053a59d4a34890a5bd18fc9b659 2023-02-10 07:56:20,930 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/35b5f053a59d4a34890a5bd18fc9b659, entries=4, sequenceid=9, filesize=5.5 K 2023-02-10 07:56:20,930 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/b509bb1a6e2b47d88bf8d047cd935fc7 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b509bb1a6e2b47d88bf8d047cd935fc7 2023-02-10 07:56:20,934 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b509bb1a6e2b47d88bf8d047cd935fc7, entries=2, sequenceid=9, filesize=5.1 K 2023-02-10 07:56:20,934 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 66779501625c4d811545b82be075e6d7 in 1725ms, sequenceid=9, compaction requested=false 2023-02-10 07:56:20,935 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 66779501625c4d811545b82be075e6d7: 2023-02-10 07:56:20,935 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:56:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:56:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-10 07:56:20,935 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-10 07:56:20,938 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,938 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:20,938 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:20,938 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:20,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-10 07:56:20,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5117dfae[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:20,939 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-10 07:56:20,940 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:20,941 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:20,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:20,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:20,941 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-10 07:56:20,941 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-10 07:56:20,941 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:20,941 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,941 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:20,942 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-10 07:56:20,942 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,942 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:20,942 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-10 07:56:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:20,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-10 07:56:20,944 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-10 07:56:20,944 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:20,944 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:20,944 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-10 07:56:20,944 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:20,945 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:20,945 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:20,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:20,945 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:20,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:20,946 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:20,947 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,949 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:20,950 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:20,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-10 07:56:20,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:20,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:20,950 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:20,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-10 07:56:20,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:21,050 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:21,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:21,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:21,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:21,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:21,055 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:21,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:21,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-10 07:56:21,056 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-10 07:56:21,056 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:21,056 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-10 07:56:21,056 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-10 07:56:21,057 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:21,057 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:21,058 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:21,058 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:21,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:21,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:21,058 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:21,058 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:21,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:21,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:21,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:21,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:21,059 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-10 07:56:21,059 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-10 07:56:21,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-10 07:56:21,059 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-10 07:56:21,059 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:21,059 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-10 07:56:21,060 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:21,060 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:56:21,060 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:21,060 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:21,060 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:21,060 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. started... 2023-02-10 07:56:21,060 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. started... 2023-02-10 07:56:21,060 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. started... 2023-02-10 07:56:21,060 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 66779501625c4d811545b82be075e6d7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:56:21,060 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c0f413ca7d85905c75919d7ff6ff1cf 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:56:21,060 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1899ad3844609850cfa35d2451de0de6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-10 07:56:21,121 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302105151703b8d164743ae858f9204223473 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302105151703b8d164743ae858f9204223473 2023-02-10 07:56:21,131 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210e9e05e65f9964faab84693396bc9ad9d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210e9e05e65f9964faab84693396bc9ad9d 2023-02-10 07:56:21,136 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/d313a838cfad4c14afced43a50e53a63 2023-02-10 07:56:21,147 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/2f658f247a45414a8117036942e51c7a 2023-02-10 07:56:21,176 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021000ecbb78850d45fb82897e0d02669ccf to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021000ecbb78850d45fb82897e0d02669ccf 2023-02-10 07:56:21,180 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/165dbc5e137a4a0cb36bd26e4eee06be 2023-02-10 07:56:21,183 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/2f658f247a45414a8117036942e51c7a as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/2f658f247a45414a8117036942e51c7a 2023-02-10 07:56:21,206 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/2f658f247a45414a8117036942e51c7a, entries=4, sequenceid=13, filesize=5.5 K 2023-02-10 07:56:21,207 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/165dbc5e137a4a0cb36bd26e4eee06be as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/165dbc5e137a4a0cb36bd26e4eee06be 2023-02-10 07:56:21,211 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/165dbc5e137a4a0cb36bd26e4eee06be, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:56:21,211 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1899ad3844609850cfa35d2451de0de6 in 151ms, sequenceid=13, compaction requested=true 2023-02-10 07:56:21,211 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1899ad3844609850cfa35d2451de0de6: 2023-02-10 07:56:21,212 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:21,212 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:56:21,517 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021057e894d2c23249b8a7115a194f8c38c2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021057e894d2c23249b8a7115a194f8c38c2 2023-02-10 07:56:21,571 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210001d3bd06cd14ccfac96912ab7adf575 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230210001d3bd06cd14ccfac96912ab7adf575 2023-02-10 07:56:21,931 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/78b9b077bfa840e995276c8c6c0f2e66 2023-02-10 07:56:21,976 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/7bece4b84ba249c99050f4f429dfb288 2023-02-10 07:56:21,979 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/d313a838cfad4c14afced43a50e53a63 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/d313a838cfad4c14afced43a50e53a63 2023-02-10 07:56:22,002 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/d313a838cfad4c14afced43a50e53a63, entries=4, sequenceid=13, filesize=5.5 K 2023-02-10 07:56:22,003 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/7bece4b84ba249c99050f4f429dfb288 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/7bece4b84ba249c99050f4f429dfb288 2023-02-10 07:56:22,006 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/7bece4b84ba249c99050f4f429dfb288, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:56:22,006 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 66779501625c4d811545b82be075e6d7 in 946ms, sequenceid=13, compaction requested=true 2023-02-10 07:56:22,007 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 66779501625c4d811545b82be075e6d7: 2023-02-10 07:56:22,007 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:22,007 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:56:22,362 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302100effd4199526439d971364e6fe9efa0a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302100effd4199526439d971364e6fe9efa0a 2023-02-10 07:56:22,767 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/1bf33f3edf184afc94364029dc206f80 2023-02-10 07:56:22,771 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/78b9b077bfa840e995276c8c6c0f2e66 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/78b9b077bfa840e995276c8c6c0f2e66 2023-02-10 07:56:22,794 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/78b9b077bfa840e995276c8c6c0f2e66, entries=4, sequenceid=13, filesize=5.5 K 2023-02-10 07:56:22,794 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/1bf33f3edf184afc94364029dc206f80 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/1bf33f3edf184afc94364029dc206f80 2023-02-10 07:56:22,798 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/1bf33f3edf184afc94364029dc206f80, entries=2, sequenceid=13, filesize=5.1 K 2023-02-10 07:56:22,798 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9c0f413ca7d85905c75919d7ff6ff1cf in 1738ms, sequenceid=13, compaction requested=true 2023-02-10 07:56:22,798 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c0f413ca7d85905c75919d7ff6ff1cf: 2023-02-10 07:56:22,798 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:22,798 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:56:22,798 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:56:22,799 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,799 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-10 07:56:22,799 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-10 07:56:22,800 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:22,800 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:22,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:22,800 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:22,800 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:22,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:22,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:22,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:22,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:22,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-10 07:56:22,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3422eef3[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:22,801 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-10 07:56:22,802 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:22,802 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:22,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:22,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:22,803 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-10 07:56:22,803 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-10 07:56:22,803 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:22,803 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,803 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:22,805 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-10 07:56:22,805 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,805 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:22,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,805 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-10 07:56:22,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:22,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:22,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:22,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:22,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:22,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:22,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:22,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:22,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-10 07:56:22,807 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-10 07:56:22,807 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:22,807 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:22,807 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-10 07:56:22,807 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:22,808 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,808 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:22,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:22,808 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:22,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:22,809 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:22,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:22,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:22,810 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:22,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:22,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:22,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:22,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:22,812 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:22,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-10 07:56:22,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:22,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:22,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:22,812 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:22,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:22,910 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-10 07:56:22,912 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:22,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:22,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:22,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:22,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-10 07:56:22,917 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:22,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:22,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-10 07:56:22,918 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-10 07:56:22,918 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:22,918 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-10 07:56:22,918 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-10 07:56:22,919 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,919 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:22,924 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:22,924 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:22,924 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:22,924 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:22,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:22,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:22,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:22,925 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-10 07:56:22,925 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-10 07:56:22,925 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-10 07:56:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-10 07:56:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-10 07:56:22,926 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:22,926 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. started... 2023-02-10 07:56:22,926 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 66779501625c4d811545b82be075e6d7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:56:22,927 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:56:22,927 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:22,927 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:22,927 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:22,927 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. started... 2023-02-10 07:56:22,927 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. started... 2023-02-10 07:56:22,927 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1899ad3844609850cfa35d2451de0de6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:56:22,927 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c0f413ca7d85905c75919d7ff6ff1cf 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-10 07:56:23,022 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:56:23,022 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20d7c20f to 127.0.0.1:54857 2023-02-10 07:56:23,022 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:56:23,038 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:56:23,038 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cc05874 to 127.0.0.1:54857 2023-02-10 07:56:23,038 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:56:23,044 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210acd7e70882064df692e28b7db381e720 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210acd7e70882064df692e28b7db381e720 2023-02-10 07:56:23,053 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210189a90b1cd5145f7bb73e0a570c45903 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230210189a90b1cd5145f7bb73e0a570c45903 2023-02-10 07:56:23,055 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302101818d7e73f5c4b738ab3788ebb8cb01f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302101818d7e73f5c4b738ab3788ebb8cb01f 2023-02-10 07:56:23,080 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/027d1f475cd648aca6788c2b75340dba 2023-02-10 07:56:23,466 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/ab15bccf24324b788897d7d677682cd2 2023-02-10 07:56:23,471 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/14d89b0f3dbf4759bdf6375a58ff71dd 2023-02-10 07:56:23,529 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021036771b786af34b85b2f829c6411855c0 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023021036771b786af34b85b2f829c6411855c0 2023-02-10 07:56:23,534 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/d9b643c3d0034dc7980727d65ea3e850 2023-02-10 07:56:23,537 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/027d1f475cd648aca6788c2b75340dba as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/027d1f475cd648aca6788c2b75340dba 2023-02-10 07:56:23,561 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/027d1f475cd648aca6788c2b75340dba, entries=4, sequenceid=17, filesize=5.5 K 2023-02-10 07:56:23,562 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/d9b643c3d0034dc7980727d65ea3e850 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/d9b643c3d0034dc7980727d65ea3e850 2023-02-10 07:56:23,566 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/d9b643c3d0034dc7980727d65ea3e850, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:56:23,566 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9c0f413ca7d85905c75919d7ff6ff1cf in 639ms, sequenceid=17, compaction requested=true 2023-02-10 07:56:23,566 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c0f413ca7d85905c75919d7ff6ff1cf: 2023-02-10 07:56:23,566 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:23,567 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:56:23,905 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210d4b8874988424f80a8fa6f875681b795 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230210d4b8874988424f80a8fa6f875681b795 2023-02-10 07:56:23,908 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021028779af5329c40a885b7aa8ec2333731 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021028779af5329c40a885b7aa8ec2333731 2023-02-10 07:56:24,310 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/e4be99979ad64f36ab459d4a34bdff83 2023-02-10 07:56:24,313 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/b72fde3486aa43f59a3cef3fc0987cc2 2023-02-10 07:56:24,314 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/ab15bccf24324b788897d7d677682cd2 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/ab15bccf24324b788897d7d677682cd2 2023-02-10 07:56:24,316 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/14d89b0f3dbf4759bdf6375a58ff71dd as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/14d89b0f3dbf4759bdf6375a58ff71dd 2023-02-10 07:56:24,339 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/14d89b0f3dbf4759bdf6375a58ff71dd, entries=4, sequenceid=17, filesize=5.5 K 2023-02-10 07:56:24,340 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/b72fde3486aa43f59a3cef3fc0987cc2 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b72fde3486aa43f59a3cef3fc0987cc2 2023-02-10 07:56:24,343 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b72fde3486aa43f59a3cef3fc0987cc2, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:56:24,344 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 66779501625c4d811545b82be075e6d7 in 1418ms, sequenceid=17, compaction requested=true 2023-02-10 07:56:24,344 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 66779501625c4d811545b82be075e6d7: 2023-02-10 07:56:24,344 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:24,344 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:56:24,349 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/ab15bccf24324b788897d7d677682cd2, entries=4, sequenceid=17, filesize=5.5 K 2023-02-10 07:56:24,350 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/e4be99979ad64f36ab459d4a34bdff83 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/e4be99979ad64f36ab459d4a34bdff83 2023-02-10 07:56:24,354 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/e4be99979ad64f36ab459d4a34bdff83, entries=2, sequenceid=17, filesize=5.1 K 2023-02-10 07:56:24,354 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1899ad3844609850cfa35d2451de0de6 in 1427ms, sequenceid=17, compaction requested=true 2023-02-10 07:56:24,354 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1899ad3844609850cfa35d2451de0de6: 2023-02-10 07:56:24,354 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:24,355 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:56:24,355 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:56:24,355 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,355 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-10 07:56:24,355 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-10 07:56:24,356 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:24,356 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:24,356 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:24,356 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:24,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-10 07:56:24,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29c6421e[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:24,358 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-10 07:56:24,358 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:24,359 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:24,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:24,359 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-10 07:56:24,359 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-10 07:56:24,359 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:24,359 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,359 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:24,360 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:24,360 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-10 07:56:24,360 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:24,360 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-10 07:56:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:24,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-10 07:56:24,362 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-10 07:56:24,362 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:24,362 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:24,362 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-10 07:56:24,362 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:24,364 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,364 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:24,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,364 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:24,365 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:24,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:24,366 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,367 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,367 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:24,367 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:24,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:24,367 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:24,367 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:24,368 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:24,368 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-10 07:56:24,368 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:24,368 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:24,368 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:24,368 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:24,368 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,368 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:24,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:24,368 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:24,468 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:24,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:24,477 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:24,484 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:24,490 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:24,491 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:24,572 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-10 07:56:24,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-10 07:56:24,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-10 07:56:24,574 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-10 07:56:24,574 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:24,574 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-10 07:56:24,574 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-10 07:56:24,575 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,575 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:24,576 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:24,576 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:24,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:24,576 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:24,576 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-10 07:56:24,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:24,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:24,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-10 07:56:24,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:24,577 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-10 07:56:24,577 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-10 07:56:24,577 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-10 07:56:24,577 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-10 07:56:24,577 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-10 07:56:24,577 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-10 07:56:24,577 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:24,577 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:24,577 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. started... 2023-02-10 07:56:24,577 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-10 07:56:24,578 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-10 07:56:24,577 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. started... 2023-02-10 07:56:24,577 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:24,578 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 1899ad3844609850cfa35d2451de0de6 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:56:24,578 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. started... 2023-02-10 07:56:24,578 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 66779501625c4d811545b82be075e6d7 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:56:24,578 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c0f413ca7d85905c75919d7ff6ff1cf 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-10 07:56:25,018 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/b5acdb6e60154fb5a97c3e550d51b5f5 2023-02-10 07:56:25,019 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/e763be1900964a019495129fe4cfd5c8 2023-02-10 07:56:25,019 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/4ee8d4b14ebf4a2795bfc0ebee05f811 2023-02-10 07:56:25,042 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e763be1900964a019495129fe4cfd5c8 2023-02-10 07:56:25,050 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5acdb6e60154fb5a97c3e550d51b5f5 2023-02-10 07:56:25,050 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ee8d4b14ebf4a2795bfc0ebee05f811 2023-02-10 07:56:25,461 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/8c0e1b7506e245f5a24be8f6d6a28191 2023-02-10 07:56:25,464 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c0e1b7506e245f5a24be8f6d6a28191 2023-02-10 07:56:25,464 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/4ee8d4b14ebf4a2795bfc0ebee05f811 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/4ee8d4b14ebf4a2795bfc0ebee05f811 2023-02-10 07:56:25,495 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4ee8d4b14ebf4a2795bfc0ebee05f811 2023-02-10 07:56:25,495 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/4ee8d4b14ebf4a2795bfc0ebee05f811, entries=3, sequenceid=23, filesize=5.2 K 2023-02-10 07:56:25,496 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/8c0e1b7506e245f5a24be8f6d6a28191 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/8c0e1b7506e245f5a24be8f6d6a28191 2023-02-10 07:56:25,499 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c0e1b7506e245f5a24be8f6d6a28191 2023-02-10 07:56:25,500 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/8c0e1b7506e245f5a24be8f6d6a28191, entries=1, sequenceid=23, filesize=5.0 K 2023-02-10 07:56:25,500 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9c0f413ca7d85905c75919d7ff6ff1cf in 922ms, sequenceid=23, compaction requested=true 2023-02-10 07:56:25,500 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c0f413ca7d85905c75919d7ff6ff1cf: 2023-02-10 07:56:25,500 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:25,501 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-10 07:56:25,855 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/5530de1375a343c8ac07365b2e1a0162 2023-02-10 07:56:25,857 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5530de1375a343c8ac07365b2e1a0162 2023-02-10 07:56:25,858 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/e763be1900964a019495129fe4cfd5c8 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/e763be1900964a019495129fe4cfd5c8 2023-02-10 07:56:25,861 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/8e9e1b0424dc4f96aea16106068ee18a 2023-02-10 07:56:25,865 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e9e1b0424dc4f96aea16106068ee18a 2023-02-10 07:56:25,866 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/b5acdb6e60154fb5a97c3e550d51b5f5 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/b5acdb6e60154fb5a97c3e550d51b5f5 2023-02-10 07:56:25,881 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e763be1900964a019495129fe4cfd5c8 2023-02-10 07:56:25,881 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/e763be1900964a019495129fe4cfd5c8, entries=3, sequenceid=23, filesize=5.2 K 2023-02-10 07:56:25,882 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/5530de1375a343c8ac07365b2e1a0162 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/5530de1375a343c8ac07365b2e1a0162 2023-02-10 07:56:25,885 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5530de1375a343c8ac07365b2e1a0162 2023-02-10 07:56:25,885 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/5530de1375a343c8ac07365b2e1a0162, entries=1, sequenceid=23, filesize=5.0 K 2023-02-10 07:56:25,886 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 66779501625c4d811545b82be075e6d7 in 1308ms, sequenceid=23, compaction requested=true 2023-02-10 07:56:25,886 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 66779501625c4d811545b82be075e6d7: 2023-02-10 07:56:25,886 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:25,886 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-10 07:56:25,888 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5acdb6e60154fb5a97c3e550d51b5f5 2023-02-10 07:56:25,888 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/b5acdb6e60154fb5a97c3e550d51b5f5, entries=3, sequenceid=23, filesize=5.2 K 2023-02-10 07:56:25,888 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/8e9e1b0424dc4f96aea16106068ee18a as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/8e9e1b0424dc4f96aea16106068ee18a 2023-02-10 07:56:25,892 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e9e1b0424dc4f96aea16106068ee18a 2023-02-10 07:56:25,892 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/8e9e1b0424dc4f96aea16106068ee18a, entries=1, sequenceid=23, filesize=5.0 K 2023-02-10 07:56:25,892 INFO [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1899ad3844609850cfa35d2451de0de6 in 1314ms, sequenceid=23, compaction requested=true 2023-02-10 07:56:25,892 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 1899ad3844609850cfa35d2451de0de6: 2023-02-10 07:56:25,892 DEBUG [rs(jenkins-hbase4.apache.org,36907,1676015618909)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-10 07:56:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-10 07:56:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-10 07:56:25,893 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-10 07:56:25,894 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,894 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:25,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:25,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:25,894 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:25,894 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-10 07:56:25,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:25,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:25,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:25,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:25,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36907,1676015618909' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-10 07:56:25,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@561a220e[Count = 0] remaining members to acquire global barrier 2023-02-10 07:56:25,896 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-10 07:56:25,896 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:25,902 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:25,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:25,903 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-10 07:56:25,903 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-10 07:56:25,903 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,36907,1676015618909' in zk 2023-02-10 07:56:25,903 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,903 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-10 07:56:25,904 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-10 07:56:25,904 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:25,904 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,904 DEBUG [member: 'jenkins-hbase4.apache.org,36907,1676015618909' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-10 07:56:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:25,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,36907,1676015618909': 2023-02-10 07:56:25,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36907,1676015618909' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-10 07:56:25,906 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-10 07:56:25,906 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-10 07:56:25,906 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-10 07:56:25,906 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-10 07:56:25,906 INFO [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-10 07:56:25,908 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:25,908 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:25,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:25,908 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-10 07:56:25,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:25,908 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:25,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-10 07:56:25,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:25,909 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-10 07:56:25,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-10 07:56:25,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-10 07:56:25,911 DEBUG [(jenkins-hbase4.apache.org,42691,1676015617779)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-10 07:56:25,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-10 07:56:25,911 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-10 07:56:25,911 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-10 07:56:25,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-10 07:56:25,911 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-10 07:56:25,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-10 07:56:25,912 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-10 07:56:25,912 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-10 07:56:25,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-10 07:56:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-10 07:56:26,012 DEBUG [Listener at localhost/46793] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-10 07:56:26,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42691] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-10 07:56:26,013 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:56:26,014 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 66779501625c4d811545b82be075e6d7/family1 is initiating major compaction (all files) 2023-02-10 07:56:26,014 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:56:26,014 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:56:26,016 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 66779501625c4d811545b82be075e6d7/family1 in testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:26,016 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/74469af1f3e54206a246be0167f50443, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/35b5f053a59d4a34890a5bd18fc9b659, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/d313a838cfad4c14afced43a50e53a63, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/14d89b0f3dbf4759bdf6375a58ff71dd, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/e763be1900964a019495129fe4cfd5c8] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp, totalSize=27.1 K 2023-02-10 07:56:26,017 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 74469af1f3e54206a246be0167f50443, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015777735 2023-02-10 07:56:26,017 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 35b5f053a59d4a34890a5bd18fc9b659, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015779202 2023-02-10 07:56:26,018 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting d313a838cfad4c14afced43a50e53a63, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015781053 2023-02-10 07:56:26,018 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 14d89b0f3dbf4759bdf6375a58ff71dd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015782915 2023-02-10 07:56:26,018 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting e763be1900964a019495129fe4cfd5c8, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:56:26,027 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 66779501625c4d811545b82be075e6d7#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:26,468 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021051ebc6606526413e93726678ef8c0b95_del 2023-02-10 07:56:26,469 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021051ebc6606526413e93726678ef8c0b95_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021051ebc6606526413e93726678ef8c0b95_del 2023-02-10 07:56:27,324 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c89e384bdd048169b0ac4412ad2a5a4 2023-02-10 07:56:27,325 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family1/7c89e384bdd048169b0ac4412ad2a5a4 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/7c89e384bdd048169b0ac4412ad2a5a4 2023-02-10 07:56:27,346 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c89e384bdd048169b0ac4412ad2a5a4 2023-02-10 07:56:27,347 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 66779501625c4d811545b82be075e6d7/family1 of 66779501625c4d811545b82be075e6d7 into 7c89e384bdd048169b0ac4412ad2a5a4(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:56:27,347 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 66779501625c4d811545b82be075e6d7: 2023-02-10 07:56:27,348 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:56:27,348 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 66779501625c4d811545b82be075e6d7/family2 is initiating major compaction (all files) 2023-02-10 07:56:27,348 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:56:27,348 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:56:27,348 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 66779501625c4d811545b82be075e6d7/family2 in testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:27,348 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/241856c4c5c14b8aacbedc5e15052148, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b509bb1a6e2b47d88bf8d047cd935fc7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/7bece4b84ba249c99050f4f429dfb288, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b72fde3486aa43f59a3cef3fc0987cc2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/5530de1375a343c8ac07365b2e1a0162] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp, totalSize=25.4 K 2023-02-10 07:56:27,349 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 241856c4c5c14b8aacbedc5e15052148, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015777735 2023-02-10 07:56:27,349 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting b509bb1a6e2b47d88bf8d047cd935fc7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015779202 2023-02-10 07:56:27,350 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 7bece4b84ba249c99050f4f429dfb288, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015781053 2023-02-10 07:56:27,350 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting b72fde3486aa43f59a3cef3fc0987cc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015782915 2023-02-10 07:56:27,350 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 5530de1375a343c8ac07365b2e1a0162, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:56:27,358 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 66779501625c4d811545b82be075e6d7#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:27,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/74469af1f3e54206a246be0167f50443, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/35b5f053a59d4a34890a5bd18fc9b659, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/d313a838cfad4c14afced43a50e53a63, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/14d89b0f3dbf4759bdf6375a58ff71dd, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/e763be1900964a019495129fe4cfd5c8] to archive 2023-02-10 07:56:27,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:27,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/74469af1f3e54206a246be0167f50443 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/74469af1f3e54206a246be0167f50443 2023-02-10 07:56:27,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/35b5f053a59d4a34890a5bd18fc9b659 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/35b5f053a59d4a34890a5bd18fc9b659 2023-02-10 07:56:27,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/d313a838cfad4c14afced43a50e53a63 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/d313a838cfad4c14afced43a50e53a63 2023-02-10 07:56:27,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/14d89b0f3dbf4759bdf6375a58ff71dd to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/14d89b0f3dbf4759bdf6375a58ff71dd 2023-02-10 07:56:27,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/e763be1900964a019495129fe4cfd5c8 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/e763be1900964a019495129fe4cfd5c8 2023-02-10 07:56:27,767 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230210b199be4bc1734bf08f83d28c8379fde2_del 2023-02-10 07:56:27,767 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210b199be4bc1734bf08f83d28c8379fde2_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230210b199be4bc1734bf08f83d28c8379fde2_del 2023-02-10 07:56:28,579 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4ea9a8d8e3e4b1e9aa6c071e5eb7191 2023-02-10 07:56:28,580 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/.tmp/family2/d4ea9a8d8e3e4b1e9aa6c071e5eb7191 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/d4ea9a8d8e3e4b1e9aa6c071e5eb7191 2023-02-10 07:56:28,583 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4ea9a8d8e3e4b1e9aa6c071e5eb7191 2023-02-10 07:56:28,583 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 66779501625c4d811545b82be075e6d7/family2 of 66779501625c4d811545b82be075e6d7 into d4ea9a8d8e3e4b1e9aa6c071e5eb7191(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:56:28,583 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 66779501625c4d811545b82be075e6d7: 2023-02-10 07:56:28,583 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:56:28,584 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 1899ad3844609850cfa35d2451de0de6/family1 is initiating major compaction (all files) 2023-02-10 07:56:28,584 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:56:28,584 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:56:28,584 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 1899ad3844609850cfa35d2451de0de6/family1 in testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:28,584 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/d0875cc5a56e442b9837195db95bd6b5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/96925d671bc54c24975ed100d738d03b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/2f658f247a45414a8117036942e51c7a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/ab15bccf24324b788897d7d677682cd2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/b5acdb6e60154fb5a97c3e550d51b5f5] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp, totalSize=27.1 K 2023-02-10 07:56:28,585 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting d0875cc5a56e442b9837195db95bd6b5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015777735 2023-02-10 07:56:28,585 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 96925d671bc54c24975ed100d738d03b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015779202 2023-02-10 07:56:28,585 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 2f658f247a45414a8117036942e51c7a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015781052 2023-02-10 07:56:28,585 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting ab15bccf24324b788897d7d677682cd2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015782914 2023-02-10 07:56:28,586 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting b5acdb6e60154fb5a97c3e550d51b5f5, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:56:28,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/241856c4c5c14b8aacbedc5e15052148, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b509bb1a6e2b47d88bf8d047cd935fc7, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/7bece4b84ba249c99050f4f429dfb288, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b72fde3486aa43f59a3cef3fc0987cc2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/5530de1375a343c8ac07365b2e1a0162] to archive 2023-02-10 07:56:28,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:28,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/241856c4c5c14b8aacbedc5e15052148 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/241856c4c5c14b8aacbedc5e15052148 2023-02-10 07:56:28,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b509bb1a6e2b47d88bf8d047cd935fc7 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b509bb1a6e2b47d88bf8d047cd935fc7 2023-02-10 07:56:28,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/7bece4b84ba249c99050f4f429dfb288 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/7bece4b84ba249c99050f4f429dfb288 2023-02-10 07:56:28,594 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 1899ad3844609850cfa35d2451de0de6#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:28,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b72fde3486aa43f59a3cef3fc0987cc2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/b72fde3486aa43f59a3cef3fc0987cc2 2023-02-10 07:56:28,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/5530de1375a343c8ac07365b2e1a0162 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family2/5530de1375a343c8ac07365b2e1a0162 2023-02-10 07:56:29,038 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230210c901b48382e645e290392e995933b961_del 2023-02-10 07:56:29,038 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210c901b48382e645e290392e995933b961_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210c901b48382e645e290392e995933b961_del 2023-02-10 07:56:29,897 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 731a70db413e4de499168d17fb0887f0 2023-02-10 07:56:29,897 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family1/731a70db413e4de499168d17fb0887f0 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/731a70db413e4de499168d17fb0887f0 2023-02-10 07:56:29,918 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 731a70db413e4de499168d17fb0887f0 2023-02-10 07:56:29,919 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1899ad3844609850cfa35d2451de0de6/family1 of 1899ad3844609850cfa35d2451de0de6 into 731a70db413e4de499168d17fb0887f0(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:56:29,919 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 1899ad3844609850cfa35d2451de0de6: 2023-02-10 07:56:29,919 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:56:29,919 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 1899ad3844609850cfa35d2451de0de6/family2 is initiating major compaction (all files) 2023-02-10 07:56:29,919 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:56:29,919 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:56:29,920 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 1899ad3844609850cfa35d2451de0de6/family2 in testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:29,920 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/cb5a07cc80d840eda43fdf59df79782f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/6d5de4f2dfb24a8786a1439ab79a8461, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/165dbc5e137a4a0cb36bd26e4eee06be, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/e4be99979ad64f36ab459d4a34bdff83, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/8e9e1b0424dc4f96aea16106068ee18a] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp, totalSize=25.4 K 2023-02-10 07:56:29,920 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting cb5a07cc80d840eda43fdf59df79782f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015777735 2023-02-10 07:56:29,921 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 6d5de4f2dfb24a8786a1439ab79a8461, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015779202 2023-02-10 07:56:29,921 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 165dbc5e137a4a0cb36bd26e4eee06be, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015781052 2023-02-10 07:56:29,921 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting e4be99979ad64f36ab459d4a34bdff83, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015782914 2023-02-10 07:56:29,922 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 8e9e1b0424dc4f96aea16106068ee18a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:56:29,929 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 1899ad3844609850cfa35d2451de0de6#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:29,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/d0875cc5a56e442b9837195db95bd6b5, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/96925d671bc54c24975ed100d738d03b, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/2f658f247a45414a8117036942e51c7a, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/ab15bccf24324b788897d7d677682cd2, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/b5acdb6e60154fb5a97c3e550d51b5f5] to archive 2023-02-10 07:56:29,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:29,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/d0875cc5a56e442b9837195db95bd6b5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/d0875cc5a56e442b9837195db95bd6b5 2023-02-10 07:56:29,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/96925d671bc54c24975ed100d738d03b to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/96925d671bc54c24975ed100d738d03b 2023-02-10 07:56:29,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/2f658f247a45414a8117036942e51c7a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/2f658f247a45414a8117036942e51c7a 2023-02-10 07:56:29,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/ab15bccf24324b788897d7d677682cd2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/ab15bccf24324b788897d7d677682cd2 2023-02-10 07:56:29,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/b5acdb6e60154fb5a97c3e550d51b5f5 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/b5acdb6e60154fb5a97c3e550d51b5f5 2023-02-10 07:56:30,337 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302103ec5ead217a842698e0870f71721e9f5_del 2023-02-10 07:56:30,337 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302103ec5ead217a842698e0870f71721e9f5_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302103ec5ead217a842698e0870f71721e9f5_del 2023-02-10 07:56:31,150 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5414e70ddb824d3fb4a2ff30c86136fa 2023-02-10 07:56:31,151 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/.tmp/family2/5414e70ddb824d3fb4a2ff30c86136fa as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/5414e70ddb824d3fb4a2ff30c86136fa 2023-02-10 07:56:31,154 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5414e70ddb824d3fb4a2ff30c86136fa 2023-02-10 07:56:31,155 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1899ad3844609850cfa35d2451de0de6/family2 of 1899ad3844609850cfa35d2451de0de6 into 5414e70ddb824d3fb4a2ff30c86136fa(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:56:31,155 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 1899ad3844609850cfa35d2451de0de6: 2023-02-10 07:56:31,155 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:56:31,155 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 9c0f413ca7d85905c75919d7ff6ff1cf/family1 is initiating major compaction (all files) 2023-02-10 07:56:31,156 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:56:31,156 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:56:31,156 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 9c0f413ca7d85905c75919d7ff6ff1cf/family1 in testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:31,157 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/d2df504616794d5fa91c288f3de62105, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/c404d11482b94d1b9325fec13f3f621f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/78b9b077bfa840e995276c8c6c0f2e66, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/027d1f475cd648aca6788c2b75340dba, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/4ee8d4b14ebf4a2795bfc0ebee05f811] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp, totalSize=27.1 K 2023-02-10 07:56:31,157 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting d2df504616794d5fa91c288f3de62105, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015777734 2023-02-10 07:56:31,157 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting c404d11482b94d1b9325fec13f3f621f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015779202 2023-02-10 07:56:31,157 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 78b9b077bfa840e995276c8c6c0f2e66, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015781052 2023-02-10 07:56:31,158 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 027d1f475cd648aca6788c2b75340dba, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015782914 2023-02-10 07:56:31,158 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 4ee8d4b14ebf4a2795bfc0ebee05f811, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:56:31,165 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 9c0f413ca7d85905c75919d7ff6ff1cf#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:31,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/cb5a07cc80d840eda43fdf59df79782f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/6d5de4f2dfb24a8786a1439ab79a8461, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/165dbc5e137a4a0cb36bd26e4eee06be, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/e4be99979ad64f36ab459d4a34bdff83, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/8e9e1b0424dc4f96aea16106068ee18a] to archive 2023-02-10 07:56:31,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:31,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/cb5a07cc80d840eda43fdf59df79782f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/cb5a07cc80d840eda43fdf59df79782f 2023-02-10 07:56:31,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/6d5de4f2dfb24a8786a1439ab79a8461 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/6d5de4f2dfb24a8786a1439ab79a8461 2023-02-10 07:56:31,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/165dbc5e137a4a0cb36bd26e4eee06be to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/165dbc5e137a4a0cb36bd26e4eee06be 2023-02-10 07:56:31,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/e4be99979ad64f36ab459d4a34bdff83 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/e4be99979ad64f36ab459d4a34bdff83 2023-02-10 07:56:31,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/8e9e1b0424dc4f96aea16106068ee18a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family2/8e9e1b0424dc4f96aea16106068ee18a 2023-02-10 07:56:31,209 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230210514885de3fcf47daac9c64b4394f8c93_del 2023-02-10 07:56:31,209 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210514885de3fcf47daac9c64b4394f8c93_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230210514885de3fcf47daac9c64b4394f8c93_del 2023-02-10 07:56:32,061 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28c0ae3972f348678867388f8bacab30 2023-02-10 07:56:32,062 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family1/28c0ae3972f348678867388f8bacab30 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/28c0ae3972f348678867388f8bacab30 2023-02-10 07:56:32,083 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28c0ae3972f348678867388f8bacab30 2023-02-10 07:56:32,084 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9c0f413ca7d85905c75919d7ff6ff1cf/family1 of 9c0f413ca7d85905c75919d7ff6ff1cf into 28c0ae3972f348678867388f8bacab30(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-10 07:56:32,084 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 9c0f413ca7d85905c75919d7ff6ff1cf: 2023-02-10 07:56:32,084 DEBUG [Listener at localhost/46793] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-10 07:56:32,084 DEBUG [Listener at localhost/46793] regionserver.HStore(1912): 9c0f413ca7d85905c75919d7ff6ff1cf/family2 is initiating major compaction (all files) 2023-02-10 07:56:32,084 INFO [Listener at localhost/46793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-10 07:56:32,084 INFO [Listener at localhost/46793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-10 07:56:32,085 INFO [Listener at localhost/46793] regionserver.HRegion(2258): Starting compaction of 9c0f413ca7d85905c75919d7ff6ff1cf/family2 in testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:32,085 INFO [Listener at localhost/46793] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/5e485b46a94b4dc2a9c00fae29c682eb, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/fab5de90b1bb4a9b960f4bf08579e53e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/1bf33f3edf184afc94364029dc206f80, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/d9b643c3d0034dc7980727d65ea3e850, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/8c0e1b7506e245f5a24be8f6d6a28191] into tmpdir=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp, totalSize=25.4 K 2023-02-10 07:56:32,085 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 5e485b46a94b4dc2a9c00fae29c682eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676015777734 2023-02-10 07:56:32,085 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting fab5de90b1bb4a9b960f4bf08579e53e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676015779202 2023-02-10 07:56:32,086 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 1bf33f3edf184afc94364029dc206f80, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676015781052 2023-02-10 07:56:32,086 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting d9b643c3d0034dc7980727d65ea3e850, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676015782914 2023-02-10 07:56:32,086 DEBUG [Listener at localhost/46793] compactions.Compactor(207): Compacting 8c0e1b7506e245f5a24be8f6d6a28191, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-10 07:56:32,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/d2df504616794d5fa91c288f3de62105, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/c404d11482b94d1b9325fec13f3f621f, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/78b9b077bfa840e995276c8c6c0f2e66, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/027d1f475cd648aca6788c2b75340dba, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/4ee8d4b14ebf4a2795bfc0ebee05f811] to archive 2023-02-10 07:56:32,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:32,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/d2df504616794d5fa91c288f3de62105 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/d2df504616794d5fa91c288f3de62105 2023-02-10 07:56:32,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/c404d11482b94d1b9325fec13f3f621f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/c404d11482b94d1b9325fec13f3f621f 2023-02-10 07:56:32,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/78b9b077bfa840e995276c8c6c0f2e66 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/78b9b077bfa840e995276c8c6c0f2e66 2023-02-10 07:56:32,093 INFO [Listener at localhost/46793] throttle.PressureAwareThroughputController(145): 9c0f413ca7d85905c75919d7ff6ff1cf#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-10 07:56:32,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/027d1f475cd648aca6788c2b75340dba to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/027d1f475cd648aca6788c2b75340dba 2023-02-10 07:56:32,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/4ee8d4b14ebf4a2795bfc0ebee05f811 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/4ee8d4b14ebf4a2795bfc0ebee05f811 2023-02-10 07:56:32,500 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230210ec78d1960c4147fd82c91fa438245848_del 2023-02-10 07:56:32,500 INFO [Listener at localhost/46793] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230210ec78d1960c4147fd82c91fa438245848_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230210ec78d1960c4147fd82c91fa438245848_del 2023-02-10 07:56:33,314 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b04ec885ffd74eab8fdca2d6e658d332 2023-02-10 07:56:33,314 DEBUG [Listener at localhost/46793] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/.tmp/family2/b04ec885ffd74eab8fdca2d6e658d332 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/b04ec885ffd74eab8fdca2d6e658d332 2023-02-10 07:56:33,318 INFO [Listener at localhost/46793] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b04ec885ffd74eab8fdca2d6e658d332 2023-02-10 07:56:33,319 INFO [Listener at localhost/46793] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9c0f413ca7d85905c75919d7ff6ff1cf/family2 of 9c0f413ca7d85905c75919d7ff6ff1cf into b04ec885ffd74eab8fdca2d6e658d332(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-10 07:56:33,319 DEBUG [Listener at localhost/46793] regionserver.HRegion(2288): Compaction status journal for 9c0f413ca7d85905c75919d7ff6ff1cf: 2023-02-10 07:56:33,322 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:33,324 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:33,327 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:33,328 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:33,333 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42691] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xF7\xBE\x05\xF2\xC4sp\xE1H\x0E\xAA\xB7\xDCS\x14E"\x10\xD4k\x97\xD1\x8DZ\x13\xBC\xB3\x82SE\x0F\x976\xA2*\x10j\xA5p\xC1b\xCC2n\x94\xEC\xB4\x0A\xF9\xB4I\xB42\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-10 07:56:33,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-10 07:56:33,355 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-10 07:56:33,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:56:33,356 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676016393356 2023-02-10 07:56:33,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-10 07:56:33,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/5e485b46a94b4dc2a9c00fae29c682eb, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/fab5de90b1bb4a9b960f4bf08579e53e, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/1bf33f3edf184afc94364029dc206f80, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/d9b643c3d0034dc7980727d65ea3e850, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/8c0e1b7506e245f5a24be8f6d6a28191] to archive 2023-02-10 07:56:33,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:33,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/5e485b46a94b4dc2a9c00fae29c682eb to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/5e485b46a94b4dc2a9c00fae29c682eb 2023-02-10 07:56:33,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/fab5de90b1bb4a9b960f4bf08579e53e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/fab5de90b1bb4a9b960f4bf08579e53e 2023-02-10 07:56:33,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/1bf33f3edf184afc94364029dc206f80 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/1bf33f3edf184afc94364029dc206f80 2023-02-10 07:56:33,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/d9b643c3d0034dc7980727d65ea3e850 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/d9b643c3d0034dc7980727d65ea3e850 2023-02-10 07:56:33,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/8c0e1b7506e245f5a24be8f6d6a28191 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family2/8c0e1b7506e245f5a24be8f6d6a28191 2023-02-10 07:56:33,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-10 07:56:33,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230210514885de3fcf47daac9c64b4394f8c93_del 2023-02-10 07:56:33,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230210c901b48382e645e290392e995933b961_del 2023-02-10 07:56:33,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021051ebc6606526413e93726678ef8c0b95_del 2023-02-10 07:56:33,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-10 07:56:33,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] zookeeper.ReadOnlyZKClient(139): Connect 0x00217545 to 127.0.0.1:54857 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-10 07:56:33,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72203035, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-10 07:56:33,790 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230210 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-10 07:56:33,809 DEBUG [regionserver/jenkins-hbase4:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-10 07:56:33,992 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230210e4dfaf4654694c878fa32a1811bde1df to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210e4dfaf4654694c878fa32a1811bde1df 2023-02-10 07:56:33,993 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230210 table='testMajorCompactionFromAdmin' column='family1' 2023-02-10 07:56:34,004 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-10 07:56:34,007 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44890, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-10 07:56:34,014 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-10 07:56:34,016 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-10 07:56:34,049 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230210/family1/9dae1e5f04c748d2b48210a63b7366ee first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-10 07:56:34,050 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230210/family1/9dae1e5f04c748d2b48210a63b7366ee}] 2023-02-10 07:56:34,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230210/family1/9dae1e5f04c748d2b48210a63b7366ee for inclusion in 1899ad3844609850cfa35d2451de0de6/family1 2023-02-10 07:56:34,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-10 07:56:34,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-10 07:56:34,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 1899ad3844609850cfa35d2451de0de6: 2023-02-10 07:56:34,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230210/family1/9dae1e5f04c748d2b48210a63b7366ee to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__k8fqiiuoi3kkhpllnk6nufl2fnlojnepffh0p8ucmme6uj5qritpkb1l308cg55t/family1/9dae1e5f04c748d2b48210a63b7366ee 2023-02-10 07:56:34,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__k8fqiiuoi3kkhpllnk6nufl2fnlojnepffh0p8ucmme6uj5qritpkb1l308cg55t/family1/9dae1e5f04c748d2b48210a63b7366ee as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/f0cf09c9e64240338f81367ee2bef279_SeqId_28_ 2023-02-10 07:56:34,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__k8fqiiuoi3kkhpllnk6nufl2fnlojnepffh0p8ucmme6uj5qritpkb1l308cg55t/family1/9dae1e5f04c748d2b48210a63b7366ee into 1899ad3844609850cfa35d2451de0de6/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/f0cf09c9e64240338f81367ee2bef279_SeqId_28_ - updating store file list. 2023-02-10 07:56:34,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/f0cf09c9e64240338f81367ee2bef279_SeqId_28_ into 1899ad3844609850cfa35d2451de0de6/family1 2023-02-10 07:56:34,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__k8fqiiuoi3kkhpllnk6nufl2fnlojnepffh0p8ucmme6uj5qritpkb1l308cg55t/family1/9dae1e5f04c748d2b48210a63b7366ee into 1899ad3844609850cfa35d2451de0de6/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/family1/f0cf09c9e64240338f81367ee2bef279_SeqId_28_) 2023-02-10 07:56:34,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__k8fqiiuoi3kkhpllnk6nufl2fnlojnepffh0p8ucmme6uj5qritpkb1l308cg55t/family1/9dae1e5f04c748d2b48210a63b7366ee 2023-02-10 07:56:34,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230210 table='testMajorCompactionFromAdmin' column='family1' 2023-02-10 07:56:34,106 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:34,107 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021017e0875291044383b9360d33ca3c52fd to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021017e0875291044383b9360d33ca3c52fd 2023-02-10 07:56:34,108 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210acd7e70882064df692e28b7db381e720 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210acd7e70882064df692e28b7db381e720 2023-02-10 07:56:34,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210b659e736866548c6a2785c377df3ea99 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210b659e736866548c6a2785c377df3ea99 2023-02-10 07:56:34,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210e9e05e65f9964faab84693396bc9ad9d to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210e9e05e65f9964faab84693396bc9ad9d 2023-02-10 07:56:34,110 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-10 07:56:34,110 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230210' 2023-02-10 07:56:34,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230210 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-10 07:56:34,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230210 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-10 07:56:34,657 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230210b10319c4de9f464ea574f0788e1ae37e to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230210b10319c4de9f464ea574f0788e1ae37e 2023-02-10 07:56:34,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='testMajorCompactionFromAdmin' column='family1' 2023-02-10 07:56:34,700 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230210/family1/e0b687187cf44f9d825b71c656206e45 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-10 07:56:34,700 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230210/family1/e0b687187cf44f9d825b71c656206e45}] 2023-02-10 07:56:34,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230210/family1/e0b687187cf44f9d825b71c656206e45 for inclusion in 66779501625c4d811545b82be075e6d7/family1 2023-02-10 07:56:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-10 07:56:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-10 07:56:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 66779501625c4d811545b82be075e6d7: 2023-02-10 07:56:34,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230210/family1/e0b687187cf44f9d825b71c656206e45 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__b2vo1u88sh5gkr9n9eikfcg790v5qpidrtf4g21ndbigeq9rd4djjvu93da6jkvr/family1/e0b687187cf44f9d825b71c656206e45 2023-02-10 07:56:34,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__b2vo1u88sh5gkr9n9eikfcg790v5qpidrtf4g21ndbigeq9rd4djjvu93da6jkvr/family1/e0b687187cf44f9d825b71c656206e45 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/6b86e39daf48444cb908db9bf1b35d30_SeqId_28_ 2023-02-10 07:56:34,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__b2vo1u88sh5gkr9n9eikfcg790v5qpidrtf4g21ndbigeq9rd4djjvu93da6jkvr/family1/e0b687187cf44f9d825b71c656206e45 into 66779501625c4d811545b82be075e6d7/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/6b86e39daf48444cb908db9bf1b35d30_SeqId_28_ - updating store file list. 2023-02-10 07:56:34,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/6b86e39daf48444cb908db9bf1b35d30_SeqId_28_ into 66779501625c4d811545b82be075e6d7/family1 2023-02-10 07:56:34,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__b2vo1u88sh5gkr9n9eikfcg790v5qpidrtf4g21ndbigeq9rd4djjvu93da6jkvr/family1/e0b687187cf44f9d825b71c656206e45 into 66779501625c4d811545b82be075e6d7/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/family1/6b86e39daf48444cb908db9bf1b35d30_SeqId_28_) 2023-02-10 07:56:34,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__b2vo1u88sh5gkr9n9eikfcg790v5qpidrtf4g21ndbigeq9rd4djjvu93da6jkvr/family1/e0b687187cf44f9d825b71c656206e45 2023-02-10 07:56:34,768 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230210 table='testMajorCompactionFromAdmin' column='family1' 2023-02-10 07:56:34,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:34,769 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021006afeb4301a64d599db57e8ffb5031cc to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021006afeb4301a64d599db57e8ffb5031cc 2023-02-10 07:56:34,770 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230210189a90b1cd5145f7bb73e0a570c45903 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230210189a90b1cd5145f7bb73e0a570c45903 2023-02-10 07:56:34,771 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021018d03f12dd8c478e9a1b40ad82e0d47a to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021018d03f12dd8c478e9a1b40ad82e0d47a 2023-02-10 07:56:34,772 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302105151703b8d164743ae858f9204223473 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302105151703b8d164743ae858f9204223473 2023-02-10 07:56:34,772 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-10 07:56:34,772 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230210' 2023-02-10 07:56:34,773 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230210 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-10 07:56:34,773 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230210 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-10 07:56:34,909 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302103a9753722d374bd58d59bede8471d979 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302103a9753722d374bd58d59bede8471d979 2023-02-10 07:56:34,910 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='testMajorCompactionFromAdmin' column='family1' 2023-02-10 07:56:34,949 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230210/family1/0e88435f5d204351a8fd7b6a7e77cd1c first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-10 07:56:34,950 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf., hostname=jenkins-hbase4.apache.org,36907,1676015618909, seqNum=2 for row with hfile group [{family1,hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230210/family1/0e88435f5d204351a8fd7b6a7e77cd1c}] 2023-02-10 07:56:34,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230210/family1/0e88435f5d204351a8fd7b6a7e77cd1c for inclusion in 9c0f413ca7d85905c75919d7ff6ff1cf/family1 2023-02-10 07:56:34,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-10 07:56:34,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last=1 2023-02-10 07:56:34,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 9c0f413ca7d85905c75919d7ff6ff1cf: 2023-02-10 07:56:34,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230210/family1/0e88435f5d204351a8fd7b6a7e77cd1c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__4aa95qg2smdv6gut79q7ddqpv37elkrkaa9ri43af6vh50r7edqo1mmgjb3n51fn/family1/0e88435f5d204351a8fd7b6a7e77cd1c 2023-02-10 07:56:34,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__4aa95qg2smdv6gut79q7ddqpv37elkrkaa9ri43af6vh50r7edqo1mmgjb3n51fn/family1/0e88435f5d204351a8fd7b6a7e77cd1c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/e17e88dfd23e464db21573804303c0e8_SeqId_28_ 2023-02-10 07:56:34,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__4aa95qg2smdv6gut79q7ddqpv37elkrkaa9ri43af6vh50r7edqo1mmgjb3n51fn/family1/0e88435f5d204351a8fd7b6a7e77cd1c into 9c0f413ca7d85905c75919d7ff6ff1cf/family1 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/e17e88dfd23e464db21573804303c0e8_SeqId_28_ - updating store file list. 2023-02-10 07:56:34,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/e17e88dfd23e464db21573804303c0e8_SeqId_28_ into 9c0f413ca7d85905c75919d7ff6ff1cf/family1 2023-02-10 07:56:34,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__4aa95qg2smdv6gut79q7ddqpv37elkrkaa9ri43af6vh50r7edqo1mmgjb3n51fn/family1/0e88435f5d204351a8fd7b6a7e77cd1c into 9c0f413ca7d85905c75919d7ff6ff1cf/family1 (new location: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/family1/e17e88dfd23e464db21573804303c0e8_SeqId_28_) 2023-02-10 07:56:34,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/staging/jenkins__testMajorCompactionFromAdmin__4aa95qg2smdv6gut79q7ddqpv37elkrkaa9ri43af6vh50r7edqo1mmgjb3n51fn/family1/0e88435f5d204351a8fd7b6a7e77cd1c 2023-02-10 07:56:34,998 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230210 table='testMajorCompactionFromAdmin' column='family1' 2023-02-10 07:56:34,998 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:34,999 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302101818d7e73f5c4b738ab3788ebb8cb01f to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302101818d7e73f5c4b738ab3788ebb8cb01f 2023-02-10 07:56:35,000 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021049f9038602e44f4097d5003b8d0f931c to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021049f9038602e44f4097d5003b8d0f931c 2023-02-10 07:56:35,001 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021057e894d2c23249b8a7115a194f8c38c2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021057e894d2c23249b8a7115a194f8c38c2 2023-02-10 07:56:35,002 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230210ace4eeeb93fd4850a66c10b100d38cb2 to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230210ace4eeeb93fd4850a66c10b100d38cb2 2023-02-10 07:56:35,002 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-10 07:56:35,002 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230210' 2023-02-10 07:56:35,002 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230210 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-10 07:56:35,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-10 07:56:35,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-10 07:56:35,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230210514885de3fcf47daac9c64b4394f8c93_del] 2023-02-10 07:56:35,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:35,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230210514885de3fcf47daac9c64b4394f8c93_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230210514885de3fcf47daac9c64b4394f8c93_del 2023-02-10 07:56:35,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-10 07:56:35,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210c901b48382e645e290392e995933b961_del] 2023-02-10 07:56:35,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:35,006 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210c901b48382e645e290392e995933b961_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230210c901b48382e645e290392e995933b961_del 2023-02-10 07:56:35,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-10 07:56:35,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] compactions.PartitionedMobCompactor(367): [hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021051ebc6606526413e93726678ef8c0b95_del] 2023-02-10 07:56:35,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] backup.HFileArchiver(360): Archiving compacted files. 2023-02-10 07:56:35,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021051ebc6606526413e93726678ef8c0b95_del to hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021051ebc6606526413e93726678ef8c0b95_del 2023-02-10 07:56:35,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-10 07:56:35,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1676015622813] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-10 07:56:35,009 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-10 07:56:35,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 1.6550 sec 2023-02-10 07:56:35,031 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:35,033 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:35,035 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-10 07:56:35,035 DEBUG [Listener at localhost/46793] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-10 07:56:35,039 INFO [Listener at localhost/46793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-10 07:56:35,049 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-10 07:56:35,073 INFO [Listener at localhost/46793] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=248 (was 252), OpenFileDescriptor=631 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=126 (was 122) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3431 (was 3459) 2023-02-10 07:56:35,073 DEBUG [Listener at localhost/46793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f46f74d to 127.0.0.1:54857 2023-02-10 07:56:35,073 DEBUG [Listener at localhost/46793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:56:35,074 INFO [Listener at localhost/46793] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-10 07:56:35,074 INFO [Listener at localhost/46793] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-10 07:56:35,074 DEBUG [Listener at localhost/46793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a675bd6 to 127.0.0.1:54857 2023-02-10 07:56:35,074 DEBUG [Listener at localhost/46793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:56:35,074 DEBUG [Listener at localhost/46793] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-10 07:56:35,074 DEBUG [Listener at localhost/46793] util.JVMClusterUtil(257): Found active master hash=358646484, stopped=false 2023-02-10 07:56:35,074 INFO [Listener at localhost/46793] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:56:35,076 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 07:56:35,076 INFO [Listener at localhost/46793] procedure2.ProcedureExecutor(629): Stopping 2023-02-10 07:56:35,076 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:56:35,076 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-10 07:56:35,076 DEBUG [Listener at localhost/46793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c4e0d58 to 127.0.0.1:54857 2023-02-10 07:56:35,076 DEBUG [Listener at localhost/46793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:56:35,076 INFO [Listener at localhost/46793] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36907,1676015618909' ***** 2023-02-10 07:56:35,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 07:56:35,076 INFO [Listener at localhost/46793] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-10 07:56:35,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-10 07:56:35,077 INFO [RS:0;jenkins-hbase4:36907] regionserver.HeapMemoryManager(220): Stopping 2023-02-10 07:56:35,077 INFO [RS:0;jenkins-hbase4:36907] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-10 07:56:35,077 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-10 07:56:35,077 INFO [RS:0;jenkins-hbase4:36907] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-10 07:56:35,077 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 3193ddb2777ba7768b31c482473b0c2d 2023-02-10 07:56:35,077 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 7b3e442243ba917643e7f579e42fd52b 2023-02-10 07:56:35,077 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for d67328b9944e1b0543f40d85608b9019 2023-02-10 07:56:35,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3193ddb2777ba7768b31c482473b0c2d, disabling compactions & flushes 2023-02-10 07:56:35,077 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for ecc368e2d160c410bd4b78c7b4016997 2023-02-10 07:56:35,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for f957aa8892773e2f88620aa538a84f16 2023-02-10 07:56:35,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 4e83904c81c27c815abba8b3a1837138 2023-02-10 07:56:35,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. after waiting 0 ms 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 744b91c8a899e9abb35ea082e625e219 2023-02-10 07:56:35,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for c9dc8a10e21dc7c3a80e8fe5db00b967 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 5d50e7bb530a01bd0ea940d256ad4a23 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for ec0b7cd10b34bade21334741c8efd2e1 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for ad05c8b2ddd0721f147299fc051d2e1b 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 66779501625c4d811545b82be075e6d7 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for ec0407a8776641eb4bea5746b0db281e 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 0aaeaf078f45314fa03e7ff30525cd63 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 2328dcff11ae9bcbfb736229cbac120f 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 44f0ab95b846f4a7edff1076e42206be 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for b5f82c81215e78518187a3656676b639 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 1899ad3844609850cfa35d2451de0de6 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 9c0f413ca7d85905c75919d7ff6ff1cf 2023-02-10 07:56:35,078 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:35,078 DEBUG [RS:0;jenkins-hbase4:36907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62f1e446 to 127.0.0.1:54857 2023-02-10 07:56:35,078 DEBUG [RS:0;jenkins-hbase4:36907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:56:35,079 INFO [RS:0;jenkins-hbase4:36907] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-10 07:56:35,079 INFO [RS:0;jenkins-hbase4:36907] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-10 07:56:35,079 INFO [RS:0;jenkins-hbase4:36907] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-10 07:56:35,079 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-10 07:56:35,079 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-10 07:56:35,079 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-10 07:56:35,080 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-10 07:56:35,080 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-10 07:56:35,080 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-10 07:56:35,080 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-10 07:56:35,080 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-10 07:56:35,080 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1505): Waiting on 0aaeaf078f45314fa03e7ff30525cd63, 1588230740, 1899ad3844609850cfa35d2451de0de6, 2328dcff11ae9bcbfb736229cbac120f, 3193ddb2777ba7768b31c482473b0c2d, 44f0ab95b846f4a7edff1076e42206be, 4e83904c81c27c815abba8b3a1837138, 5d50e7bb530a01bd0ea940d256ad4a23, 66779501625c4d811545b82be075e6d7, 744b91c8a899e9abb35ea082e625e219, 7b3e442243ba917643e7f579e42fd52b, 9c0f413ca7d85905c75919d7ff6ff1cf, ad05c8b2ddd0721f147299fc051d2e1b, b5f82c81215e78518187a3656676b639, c9dc8a10e21dc7c3a80e8fe5db00b967, d67328b9944e1b0543f40d85608b9019, ec0407a8776641eb4bea5746b0db281e, ec0b7cd10b34bade21334741c8efd2e1, ecc368e2d160c410bd4b78c7b4016997, f957aa8892773e2f88620aa538a84f16, ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:56:35,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/3193ddb2777ba7768b31c482473b0c2d/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-10 07:56:35,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:56:35,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3193ddb2777ba7768b31c482473b0c2d: Waiting for close lock at 1676015795077Running coprocessor pre-close hooks at 1676015795077Disabling compacts and flushes for region at 1676015795077Disabling writes for close at 1676015795078 (+1 ms)Writing region close event to WAL at 1676015795079 (+1 ms)Running coprocessor post-close hooks at 1676015795082 (+3 ms)Closed at 1676015795083 (+1 ms) 2023-02-10 07:56:35,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676015716082.3193ddb2777ba7768b31c482473b0c2d. 2023-02-10 07:56:35,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7b3e442243ba917643e7f579e42fd52b, disabling compactions & flushes 2023-02-10 07:56:35,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:56:35,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:56:35,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. after waiting 0 ms 2023-02-10 07:56:35,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:56:35,092 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-10 07:56:35,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/7b3e442243ba917643e7f579e42fd52b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-10 07:56:35,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:56:35,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7b3e442243ba917643e7f579e42fd52b: Waiting for close lock at 1676015795083Running coprocessor pre-close hooks at 1676015795083Disabling compacts and flushes for region at 1676015795083Disabling writes for close at 1676015795083Writing region close event to WAL at 1676015795084 (+1 ms)Running coprocessor post-close hooks at 1676015795092 (+8 ms)Closed at 1676015795093 (+1 ms) 2023-02-10 07:56:35,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676015744716.7b3e442243ba917643e7f579e42fd52b. 2023-02-10 07:56:35,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d67328b9944e1b0543f40d85608b9019, disabling compactions & flushes 2023-02-10 07:56:35,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:56:35,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:56:35,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. after waiting 0 ms 2023-02-10 07:56:35,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:56:35,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d67328b9944e1b0543f40d85608b9019/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-10 07:56:35,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:56:35,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d67328b9944e1b0543f40d85608b9019: Waiting for close lock at 1676015795093Running coprocessor pre-close hooks at 1676015795093Disabling compacts and flushes for region at 1676015795093Disabling writes for close at 1676015795093Writing region close event to WAL at 1676015795094 (+1 ms)Running coprocessor post-close hooks at 1676015795097 (+3 ms)Closed at 1676015795097 2023-02-10 07:56:35,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676015677696.d67328b9944e1b0543f40d85608b9019. 2023-02-10 07:56:35,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ecc368e2d160c410bd4b78c7b4016997, disabling compactions & flushes 2023-02-10 07:56:35,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:56:35,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:56:35,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. after waiting 0 ms 2023-02-10 07:56:35,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:56:35,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyPolicy/ecc368e2d160c410bd4b78c7b4016997/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-10 07:56:35,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:56:35,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ecc368e2d160c410bd4b78c7b4016997: Waiting for close lock at 1676015795098Running coprocessor pre-close hooks at 1676015795098Disabling compacts and flushes for region at 1676015795098Disabling writes for close at 1676015795098Writing region close event to WAL at 1676015795098Running coprocessor post-close hooks at 1676015795101 (+3 ms)Closed at 1676015795102 (+1 ms) 2023-02-10 07:56:35,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676015664448.ecc368e2d160c410bd4b78c7b4016997. 2023-02-10 07:56:35,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f957aa8892773e2f88620aa538a84f16, disabling compactions & flushes 2023-02-10 07:56:35,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:56:35,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:56:35,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. after waiting 0 ms 2023-02-10 07:56:35,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:56:35,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/f957aa8892773e2f88620aa538a84f16/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-10 07:56:35,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:56:35,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f957aa8892773e2f88620aa538a84f16: Waiting for close lock at 1676015795102Running coprocessor pre-close hooks at 1676015795102Disabling compacts and flushes for region at 1676015795102Disabling writes for close at 1676015795102Writing region close event to WAL at 1676015795104 (+2 ms)Running coprocessor post-close hooks at 1676015795106 (+2 ms)Closed at 1676015795107 (+1 ms) 2023-02-10 07:56:35,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676015659451.f957aa8892773e2f88620aa538a84f16. 2023-02-10 07:56:35,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4e83904c81c27c815abba8b3a1837138, disabling compactions & flushes 2023-02-10 07:56:35,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:56:35,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:56:35,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. after waiting 0 ms 2023-02-10 07:56:35,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:56:35,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithMonthlyPolicy/4e83904c81c27c815abba8b3a1837138/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-10 07:56:35,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:56:35,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4e83904c81c27c815abba8b3a1837138: Waiting for close lock at 1676015795107Running coprocessor pre-close hooks at 1676015795107Disabling compacts and flushes for region at 1676015795107Disabling writes for close at 1676015795107Writing region close event to WAL at 1676015795108 (+1 ms)Running coprocessor post-close hooks at 1676015795110 (+2 ms)Closed at 1676015795110 2023-02-10 07:56:35,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676015637981.4e83904c81c27c815abba8b3a1837138. 2023-02-10 07:56:35,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 744b91c8a899e9abb35ea082e625e219, disabling compactions & flushes 2023-02-10 07:56:35,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:56:35,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:56:35,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. after waiting 0 ms 2023-02-10 07:56:35,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:56:35,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/744b91c8a899e9abb35ea082e625e219/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-10 07:56:35,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:56:35,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 744b91c8a899e9abb35ea082e625e219: Waiting for close lock at 1676015795111Running coprocessor pre-close hooks at 1676015795111Disabling compacts and flushes for region at 1676015795111Disabling writes for close at 1676015795111Writing region close event to WAL at 1676015795112 (+1 ms)Running coprocessor post-close hooks at 1676015795114 (+2 ms)Closed at 1676015795114 2023-02-10 07:56:35,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676015716082.744b91c8a899e9abb35ea082e625e219. 2023-02-10 07:56:35,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c9dc8a10e21dc7c3a80e8fe5db00b967, disabling compactions & flushes 2023-02-10 07:56:35,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:56:35,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:56:35,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. after waiting 0 ms 2023-02-10 07:56:35,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:56:35,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/c9dc8a10e21dc7c3a80e8fe5db00b967/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-10 07:56:35,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:56:35,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c9dc8a10e21dc7c3a80e8fe5db00b967: Waiting for close lock at 1676015795115Running coprocessor pre-close hooks at 1676015795115Disabling compacts and flushes for region at 1676015795115Disabling writes for close at 1676015795115Writing region close event to WAL at 1676015795118 (+3 ms)Running coprocessor post-close hooks at 1676015795120 (+2 ms)Closed at 1676015795121 (+1 ms) 2023-02-10 07:56:35,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676015744716.c9dc8a10e21dc7c3a80e8fe5db00b967. 2023-02-10 07:56:35,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5d50e7bb530a01bd0ea940d256ad4a23, disabling compactions & flushes 2023-02-10 07:56:35,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:56:35,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:56:35,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. after waiting 0 ms 2023-02-10 07:56:35,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:56:35,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/5d50e7bb530a01bd0ea940d256ad4a23/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-10 07:56:35,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:56:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5d50e7bb530a01bd0ea940d256ad4a23: Waiting for close lock at 1676015795121Running coprocessor pre-close hooks at 1676015795121Disabling compacts and flushes for region at 1676015795121Disabling writes for close at 1676015795121Writing region close event to WAL at 1676015795122 (+1 ms)Running coprocessor post-close hooks at 1676015795124 (+2 ms)Closed at 1676015795125 (+1 ms) 2023-02-10 07:56:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676015659451.5d50e7bb530a01bd0ea940d256ad4a23. 2023-02-10 07:56:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ec0b7cd10b34bade21334741c8efd2e1, disabling compactions & flushes 2023-02-10 07:56:35,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:56:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:56:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. after waiting 0 ms 2023-02-10 07:56:35,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:56:35,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ec0b7cd10b34bade21334741c8efd2e1 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-10 07:56:35,143 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-10 07:56:35,280 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1505): Waiting on 0aaeaf078f45314fa03e7ff30525cd63, 1588230740, 1899ad3844609850cfa35d2451de0de6, 2328dcff11ae9bcbfb736229cbac120f, 44f0ab95b846f4a7edff1076e42206be, 66779501625c4d811545b82be075e6d7, 9c0f413ca7d85905c75919d7ff6ff1cf, ad05c8b2ddd0721f147299fc051d2e1b, b5f82c81215e78518187a3656676b639, ec0407a8776641eb4bea5746b0db281e, ec0b7cd10b34bade21334741c8efd2e1, ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:56:35,457 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-10 07:56:35,457 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-10 07:56:35,481 DEBUG [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1505): Waiting on 0aaeaf078f45314fa03e7ff30525cd63, 1588230740, 1899ad3844609850cfa35d2451de0de6, 2328dcff11ae9bcbfb736229cbac120f, 44f0ab95b846f4a7edff1076e42206be, 66779501625c4d811545b82be075e6d7, 9c0f413ca7d85905c75919d7ff6ff1cf, ad05c8b2ddd0721f147299fc051d2e1b, b5f82c81215e78518187a3656676b639, ec0407a8776641eb4bea5746b0db281e, ec0b7cd10b34bade21334741c8efd2e1, ff8b684a362b59eaec4d1812a47bc303 2023-02-10 07:56:35,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/.tmp/info/5740b4b98cad4017b2e45f7a47767788 2023-02-10 07:56:35,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5740b4b98cad4017b2e45f7a47767788 2023-02-10 07:56:35,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/.tmp/rep_barrier/452a54303fb346c6b14a083bcbde069c 2023-02-10 07:56:35,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 452a54303fb346c6b14a083bcbde069c 2023-02-10 07:56:35,515 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/.tmp/table/3569ba33433b40f8b32eed8ed152db0a 2023-02-10 07:56:35,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3569ba33433b40f8b32eed8ed152db0a 2023-02-10 07:56:35,522 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/.tmp/info/5740b4b98cad4017b2e45f7a47767788 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/info/5740b4b98cad4017b2e45f7a47767788 2023-02-10 07:56:35,525 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5740b4b98cad4017b2e45f7a47767788 2023-02-10 07:56:35,525 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/info/5740b4b98cad4017b2e45f7a47767788, entries=226, sequenceid=130, filesize=37.9 K 2023-02-10 07:56:35,526 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/.tmp/rep_barrier/452a54303fb346c6b14a083bcbde069c as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/rep_barrier/452a54303fb346c6b14a083bcbde069c 2023-02-10 07:56:35,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 452a54303fb346c6b14a083bcbde069c 2023-02-10 07:56:35,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/rep_barrier/452a54303fb346c6b14a083bcbde069c, entries=1, sequenceid=130, filesize=5.0 K 2023-02-10 07:56:35,529 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/.tmp/table/3569ba33433b40f8b32eed8ed152db0a as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/table/3569ba33433b40f8b32eed8ed152db0a 2023-02-10 07:56:35,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1/.tmp/info/631246b2bfca4de4b89e410e81509bc4 2023-02-10 07:56:35,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3569ba33433b40f8b32eed8ed152db0a 2023-02-10 07:56:35,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/table/3569ba33433b40f8b32eed8ed152db0a, entries=27, sequenceid=130, filesize=6.6 K 2023-02-10 07:56:35,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 452ms, sequenceid=130, compaction requested=false 2023-02-10 07:56:35,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1/.tmp/info/631246b2bfca4de4b89e410e81509bc4 as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1/info/631246b2bfca4de4b89e410e81509bc4 2023-02-10 07:56:35,536 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-10 07:56:35,537 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-10 07:56:35,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-10 07:56:35,537 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676015795079Running coprocessor pre-close hooks at 1676015795079Disabling compacts and flushes for region at 1676015795079Disabling writes for close at 1676015795080 (+1 ms)Obtaining lock to block concurrent updates at 1676015795080Preparing flush snapshotting stores in 1588230740 at 1676015795080Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676015795080Flushing stores of hbase:meta,,1.1588230740 at 1676015795080Flushing 1588230740/info: creating writer at 1676015795080Flushing 1588230740/info: appending metadata at 1676015795084 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676015795085 (+1 ms)Flushing 1588230740/rep_barrier: creating writer at 1676015795499 (+414 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676015795501 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676015795501Flushing 1588230740/table: creating writer at 1676015795510 (+9 ms)Flushing 1588230740/table: appending metadata at 1676015795511 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676015795511Flushing 1588230740/info: reopening flushed file at 1676015795522 (+11 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676015795526 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676015795529 (+3 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 452ms, sequenceid=130, compaction requested=false at 1676015795533 (+4 ms)Writing region close event to WAL at 1676015795534 (+1 ms)Running coprocessor post-close hooks at 1676015795537 (+3 ms)Closed at 1676015795537 2023-02-10 07:56:35,537 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-10 07:56:35,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1/info/631246b2bfca4de4b89e410e81509bc4, entries=3, sequenceid=7, filesize=4.8 K 2023-02-10 07:56:35,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for ec0b7cd10b34bade21334741c8efd2e1 in 415ms, sequenceid=7, compaction requested=false 2023-02-10 07:56:35,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/hbase/namespace/ec0b7cd10b34bade21334741c8efd2e1/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-10 07:56:35,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:56:35,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ec0b7cd10b34bade21334741c8efd2e1: Waiting for close lock at 1676015795125Running coprocessor pre-close hooks at 1676015795125Disabling compacts and flushes for region at 1676015795125Disabling writes for close at 1676015795125Obtaining lock to block concurrent updates at 1676015795125Preparing flush snapshotting stores in ec0b7cd10b34bade21334741c8efd2e1 at 1676015795125Finished memstore snapshotting hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676015795125Flushing stores of hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. at 1676015795126 (+1 ms)Flushing ec0b7cd10b34bade21334741c8efd2e1/info: creating writer at 1676015795126Flushing ec0b7cd10b34bade21334741c8efd2e1/info: appending metadata at 1676015795127 (+1 ms)Flushing ec0b7cd10b34bade21334741c8efd2e1/info: closing flushed file at 1676015795128 (+1 ms)Flushing ec0b7cd10b34bade21334741c8efd2e1/info: reopening flushed file at 1676015795535 (+407 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for ec0b7cd10b34bade21334741c8efd2e1 in 415ms, sequenceid=7, compaction requested=false at 1676015795540 (+5 ms)Writing region close event to WAL at 1676015795541 (+1 ms)Running coprocessor post-close hooks at 1676015795544 (+3 ms)Closed at 1676015795544 2023-02-10 07:56:35,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676015621793.ec0b7cd10b34bade21334741c8efd2e1. 2023-02-10 07:56:35,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ad05c8b2ddd0721f147299fc051d2e1b, disabling compactions & flushes 2023-02-10 07:56:35,544 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:56:35,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:56:35,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. after waiting 0 ms 2023-02-10 07:56:35,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:56:35,547 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/ns/testMinorCompaction/ad05c8b2ddd0721f147299fc051d2e1b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-10 07:56:35,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:56:35,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ad05c8b2ddd0721f147299fc051d2e1b: Waiting for close lock at 1676015795544Running coprocessor pre-close hooks at 1676015795544Disabling compacts and flushes for region at 1676015795544Disabling writes for close at 1676015795544Writing region close event to WAL at 1676015795545 (+1 ms)Running coprocessor post-close hooks at 1676015795547 (+2 ms)Closed at 1676015795548 (+1 ms) 2023-02-10 07:56:35,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676015744716.ad05c8b2ddd0721f147299fc051d2e1b. 2023-02-10 07:56:35,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 66779501625c4d811545b82be075e6d7, disabling compactions & flushes 2023-02-10 07:56:35,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:35,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:35,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. after waiting 0 ms 2023-02-10 07:56:35,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:35,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/66779501625c4d811545b82be075e6d7/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-10 07:56:35,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:35,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 66779501625c4d811545b82be075e6d7: Waiting for close lock at 1676015795548Running coprocessor pre-close hooks at 1676015795548Disabling compacts and flushes for region at 1676015795548Disabling writes for close at 1676015795548Writing region close event to WAL at 1676015795549 (+1 ms)Running coprocessor post-close hooks at 1676015795551 (+2 ms)Closed at 1676015795552 (+1 ms) 2023-02-10 07:56:35,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676015776591.66779501625c4d811545b82be075e6d7. 2023-02-10 07:56:35,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ec0407a8776641eb4bea5746b0db281e, disabling compactions & flushes 2023-02-10 07:56:35,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:56:35,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:56:35,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. after waiting 0 ms 2023-02-10 07:56:35,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:56:35,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithWeeklyPolicy/ec0407a8776641eb4bea5746b0db281e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-10 07:56:35,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:56:35,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ec0407a8776641eb4bea5746b0db281e: Waiting for close lock at 1676015795552Running coprocessor pre-close hooks at 1676015795552Disabling compacts and flushes for region at 1676015795552Disabling writes for close at 1676015795552Writing region close event to WAL at 1676015795553 (+1 ms)Running coprocessor post-close hooks at 1676015795555 (+2 ms)Closed at 1676015795555 2023-02-10 07:56:35,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676015648682.ec0407a8776641eb4bea5746b0db281e. 2023-02-10 07:56:35,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0aaeaf078f45314fa03e7ff30525cd63, disabling compactions & flushes 2023-02-10 07:56:35,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:56:35,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:56:35,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. after waiting 0 ms 2023-02-10 07:56:35,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:56:35,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testScannerOnBulkLoadRefHFiles/0aaeaf078f45314fa03e7ff30525cd63/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-10 07:56:35,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:56:35,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0aaeaf078f45314fa03e7ff30525cd63: Waiting for close lock at 1676015795555Running coprocessor pre-close hooks at 1676015795555Disabling compacts and flushes for region at 1676015795555Disabling writes for close at 1676015795555Writing region close event to WAL at 1676015795556 (+1 ms)Running coprocessor post-close hooks at 1676015795558 (+2 ms)Closed at 1676015795558 2023-02-10 07:56:35,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676015659451.0aaeaf078f45314fa03e7ff30525cd63. 2023-02-10 07:56:35,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ff8b684a362b59eaec4d1812a47bc303, disabling compactions & flushes 2023-02-10 07:56:35,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:56:35,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:56:35,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. after waiting 0 ms 2023-02-10 07:56:35,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:56:35,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testCompactionWithHFileLink/ff8b684a362b59eaec4d1812a47bc303/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-10 07:56:35,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:56:35,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ff8b684a362b59eaec4d1812a47bc303: Waiting for close lock at 1676015795558Running coprocessor pre-close hooks at 1676015795558Disabling compacts and flushes for region at 1676015795558Disabling writes for close at 1676015795558Writing region close event to WAL at 1676015795559 (+1 ms)Running coprocessor post-close hooks at 1676015795561 (+2 ms)Closed at 1676015795561 2023-02-10 07:56:35,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676015716082.ff8b684a362b59eaec4d1812a47bc303. 2023-02-10 07:56:35,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2328dcff11ae9bcbfb736229cbac120f, disabling compactions & flushes 2023-02-10 07:56:35,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:56:35,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:56:35,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. after waiting 0 ms 2023-02-10 07:56:35,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:56:35,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/2328dcff11ae9bcbfb736229cbac120f/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-10 07:56:35,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:56:35,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2328dcff11ae9bcbfb736229cbac120f: Waiting for close lock at 1676015795561Running coprocessor pre-close hooks at 1676015795561Disabling compacts and flushes for region at 1676015795561Disabling writes for close at 1676015795561Writing region close event to WAL at 1676015795561Running coprocessor post-close hooks at 1676015795563 (+2 ms)Closed at 1676015795563 2023-02-10 07:56:35,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676015694327.2328dcff11ae9bcbfb736229cbac120f. 2023-02-10 07:56:35,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 44f0ab95b846f4a7edff1076e42206be, disabling compactions & flushes 2023-02-10 07:56:35,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:35,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:35,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. after waiting 0 ms 2023-02-10 07:56:35,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:35,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMinorCompactionWithMonthlyPolicy/44f0ab95b846f4a7edff1076e42206be/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-10 07:56:35,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:35,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 44f0ab95b846f4a7edff1076e42206be: Waiting for close lock at 1676015795564Running coprocessor pre-close hooks at 1676015795564Disabling compacts and flushes for region at 1676015795564Disabling writes for close at 1676015795564Writing region close event to WAL at 1676015795564Running coprocessor post-close hooks at 1676015795566 (+2 ms)Closed at 1676015795566 2023-02-10 07:56:35,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676015763264.44f0ab95b846f4a7edff1076e42206be. 2023-02-10 07:56:35,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b5f82c81215e78518187a3656676b639, disabling compactions & flushes 2023-02-10 07:56:35,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:56:35,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:56:35,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. after waiting 0 ms 2023-02-10 07:56:35,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:56:35,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/b5f82c81215e78518187a3656676b639/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-10 07:56:35,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:56:35,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b5f82c81215e78518187a3656676b639: Waiting for close lock at 1676015795567Running coprocessor pre-close hooks at 1676015795567Disabling compacts and flushes for region at 1676015795567Disabling writes for close at 1676015795567Writing region close event to WAL at 1676015795567Running coprocessor post-close hooks at 1676015795569 (+2 ms)Closed at 1676015795569 2023-02-10 07:56:35,569 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676015622939.b5f82c81215e78518187a3656676b639. 2023-02-10 07:56:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1899ad3844609850cfa35d2451de0de6, disabling compactions & flushes 2023-02-10 07:56:35,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. after waiting 0 ms 2023-02-10 07:56:35,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:35,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/1899ad3844609850cfa35d2451de0de6/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-10 07:56:35,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:35,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1899ad3844609850cfa35d2451de0de6: Waiting for close lock at 1676015795570Running coprocessor pre-close hooks at 1676015795570Disabling compacts and flushes for region at 1676015795570Disabling writes for close at 1676015795570Writing region close event to WAL at 1676015795571 (+1 ms)Running coprocessor post-close hooks at 1676015795572 (+1 ms)Closed at 1676015795573 (+1 ms) 2023-02-10 07:56:35,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676015776591.1899ad3844609850cfa35d2451de0de6. 2023-02-10 07:56:35,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9c0f413ca7d85905c75919d7ff6ff1cf, disabling compactions & flushes 2023-02-10 07:56:35,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:35,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:35,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. after waiting 0 ms 2023-02-10 07:56:35,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:35,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/data/default/testMajorCompactionFromAdmin/9c0f413ca7d85905c75919d7ff6ff1cf/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-10 07:56:35,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:35,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9c0f413ca7d85905c75919d7ff6ff1cf: Waiting for close lock at 1676015795573Running coprocessor pre-close hooks at 1676015795573Disabling compacts and flushes for region at 1676015795573Disabling writes for close at 1676015795573Writing region close event to WAL at 1676015795574 (+1 ms)Running coprocessor post-close hooks at 1676015795575 (+1 ms)Closed at 1676015795575 2023-02-10 07:56:35,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676015776591.9c0f413ca7d85905c75919d7ff6ff1cf. 2023-02-10 07:56:35,681 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36907,1676015618909; all regions closed. 2023-02-10 07:56:35,687 DEBUG [RS:0;jenkins-hbase4:36907] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/oldWALs 2023-02-10 07:56:35,688 INFO [RS:0;jenkins-hbase4:36907] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36907%2C1676015618909.meta:.meta(num 1676015621558) 2023-02-10 07:56:35,691 DEBUG [RS:0;jenkins-hbase4:36907] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/oldWALs 2023-02-10 07:56:35,691 INFO [RS:0;jenkins-hbase4:36907] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36907%2C1676015618909:(num 1676015620602) 2023-02-10 07:56:35,691 DEBUG [RS:0;jenkins-hbase4:36907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:56:35,691 INFO [RS:0;jenkins-hbase4:36907] regionserver.LeaseManager(133): Closed leases 2023-02-10 07:56:35,692 INFO [RS:0;jenkins-hbase4:36907] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-10 07:56:35,692 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 07:56:35,693 INFO [RS:0;jenkins-hbase4:36907] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36907 2023-02-10 07:56:35,701 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36907,1676015618909 2023-02-10 07:56:35,701 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 07:56:35,702 ERROR [Listener at localhost/46793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a89915e rejected from java.util.concurrent.ThreadPoolExecutor@4eb61cd7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 07:56:35,702 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-10 07:56:35,702 ERROR [Listener at localhost/46793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cf026fb rejected from java.util.concurrent.ThreadPoolExecutor@4eb61cd7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 07:56:35,702 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36907,1676015618909] 2023-02-10 07:56:35,703 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36907,1676015618909; numProcessing=1 2023-02-10 07:56:35,704 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36907,1676015618909 already deleted, retry=false 2023-02-10 07:56:35,704 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36907,1676015618909 expired; onlineServers=0 2023-02-10 07:56:35,704 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42691,1676015617779' ***** 2023-02-10 07:56:35,704 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-10 07:56:35,705 DEBUG [M:0;jenkins-hbase4:42691] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@545d88ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-10 07:56:35,705 INFO [M:0;jenkins-hbase4:42691] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42691,1676015617779 2023-02-10 07:56:35,705 INFO [M:0;jenkins-hbase4:42691] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42691,1676015617779; all regions closed. 2023-02-10 07:56:35,705 DEBUG [M:0;jenkins-hbase4:42691] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-10 07:56:35,705 DEBUG [M:0;jenkins-hbase4:42691] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-10 07:56:35,705 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-10 07:56:35,705 DEBUG [M:0;jenkins-hbase4:42691] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-10 07:56:35,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676015620303] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676015620303,5,FailOnTimeoutGroup] 2023-02-10 07:56:35,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676015620303] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676015620303,5,FailOnTimeoutGroup] 2023-02-10 07:56:35,705 INFO [M:0;jenkins-hbase4:42691] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-10 07:56:35,705 INFO [M:0;jenkins-hbase4:42691] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-10 07:56:35,705 INFO [M:0;jenkins-hbase4:42691] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-10 07:56:35,706 DEBUG [M:0;jenkins-hbase4:42691] master.HMaster(1502): Stopping service threads 2023-02-10 07:56:35,706 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-10 07:56:35,706 INFO [M:0;jenkins-hbase4:42691] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-10 07:56:35,706 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-10 07:56:35,706 ERROR [M:0;jenkins-hbase4:42691] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-10 07:56:35,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-10 07:56:35,707 INFO [M:0;jenkins-hbase4:42691] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-10 07:56:35,707 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-10 07:56:35,707 DEBUG [M:0;jenkins-hbase4:42691] zookeeper.ZKUtil(398): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-10 07:56:35,707 WARN [M:0;jenkins-hbase4:42691] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-10 07:56:35,707 INFO [M:0;jenkins-hbase4:42691] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-10 07:56:35,707 INFO [M:0;jenkins-hbase4:42691] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-10 07:56:35,708 DEBUG [M:0;jenkins-hbase4:42691] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-10 07:56:35,708 INFO [M:0;jenkins-hbase4:42691] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 07:56:35,708 DEBUG [M:0;jenkins-hbase4:42691] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 07:56:35,708 DEBUG [M:0;jenkins-hbase4:42691] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-10 07:56:35,708 DEBUG [M:0;jenkins-hbase4:42691] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 07:56:35,708 INFO [M:0;jenkins-hbase4:42691] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.76 KB heapSize=598.54 KB 2023-02-10 07:56:35,803 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 07:56:35,803 INFO [RS:0;jenkins-hbase4:36907] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36907,1676015618909; zookeeper connection closed. 2023-02-10 07:56:35,803 ERROR [Listener at localhost/46793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@445bb077 rejected from java.util.concurrent.ThreadPoolExecutor@4eb61cd7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 07:56:35,803 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1003d38ad880001, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 07:56:35,803 ERROR [Listener at localhost/46793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5661405c rejected from java.util.concurrent.ThreadPoolExecutor@4eb61cd7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 07:56:35,803 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c1f8a64] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c1f8a64 2023-02-10 07:56:35,803 INFO [Listener at localhost/46793] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-10 07:56:36,115 INFO [M:0;jenkins-hbase4:42691] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.76 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/70c73818768b49cda47b8c3b4a115bbf 2023-02-10 07:56:36,120 INFO [M:0;jenkins-hbase4:42691] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70c73818768b49cda47b8c3b4a115bbf 2023-02-10 07:56:36,121 DEBUG [M:0;jenkins-hbase4:42691] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/70c73818768b49cda47b8c3b4a115bbf as hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/70c73818768b49cda47b8c3b4a115bbf 2023-02-10 07:56:36,125 INFO [M:0;jenkins-hbase4:42691] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70c73818768b49cda47b8c3b4a115bbf 2023-02-10 07:56:36,125 INFO [M:0;jenkins-hbase4:42691] regionserver.HStore(1080): Added hdfs://localhost:39777/user/jenkins/test-data/0005e15e-3ab9-1713-4ce4-1b91de8b5217/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/70c73818768b49cda47b8c3b4a115bbf, entries=123, sequenceid=1005, filesize=33.3 K 2023-02-10 07:56:36,125 INFO [M:0;jenkins-hbase4:42691] regionserver.HRegion(2947): Finished flush of dataSize ~512.76 KB/525069, heapSize ~598.52 KB/612888, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1005, compaction requested=false 2023-02-10 07:56:36,126 INFO [M:0;jenkins-hbase4:42691] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-10 07:56:36,126 DEBUG [M:0;jenkins-hbase4:42691] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676015795708Disabling compacts and flushes for region at 1676015795708Disabling writes for close at 1676015795708Obtaining lock to block concurrent updates at 1676015795708Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676015795708Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525069, getHeapSize=612888, getOffHeapSize=0, getCellsCount=1160 at 1676015795708Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676015795708Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676015795708Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676015795711 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676015795711Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676015796122 (+411 ms)Finished flush of dataSize ~512.76 KB/525069, heapSize ~598.52 KB/612888, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 417ms, sequenceid=1005, compaction requested=false at 1676015796125 (+3 ms)Writing region close event to WAL at 1676015796126 (+1 ms)Closed at 1676015796126 2023-02-10 07:56:36,128 INFO [M:0;jenkins-hbase4:42691] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-10 07:56:36,128 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-10 07:56:36,129 INFO [M:0;jenkins-hbase4:42691] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42691 2023-02-10 07:56:36,132 DEBUG [M:0;jenkins-hbase4:42691] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42691,1676015617779 already deleted, retry=false 2023-02-10 07:56:36,234 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 07:56:36,234 INFO [M:0;jenkins-hbase4:42691] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42691,1676015617779; zookeeper connection closed. 2023-02-10 07:56:36,234 ERROR [Listener at localhost/46793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c3acbf0 rejected from java.util.concurrent.ThreadPoolExecutor@e5b3ce8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 07:56:36,234 DEBUG [Listener at localhost/46793-EventThread] zookeeper.ZKWatcher(600): master:42691-0x1003d38ad880000, quorum=127.0.0.1:54857, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-10 07:56:36,234 ERROR [Listener at localhost/46793-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@180ba163 rejected from java.util.concurrent.ThreadPoolExecutor@e5b3ce8[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-10 07:56:36,235 WARN [Listener at localhost/46793] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-10 07:56:36,239 INFO [Listener at localhost/46793] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 07:56:36,346 WARN [BP-2131529517-172.31.14.131-1676015614786 heartbeating to localhost/127.0.0.1:39777] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-10 07:56:36,346 WARN [BP-2131529517-172.31.14.131-1676015614786 heartbeating to localhost/127.0.0.1:39777] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2131529517-172.31.14.131-1676015614786 (Datanode Uuid bfc92a38-a2a1-470c-a604-f4f6b4dea777) service to localhost/127.0.0.1:39777 2023-02-10 07:56:36,349 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/cluster_ca906608-436c-7df5-28a0-58c9b32cd1e1/dfs/data/data1/current/BP-2131529517-172.31.14.131-1676015614786] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 07:56:36,349 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1c42ffa4-415b-79c0-40a8-8a2c65860f9d/cluster_ca906608-436c-7df5-28a0-58c9b32cd1e1/dfs/data/data2/current/BP-2131529517-172.31.14.131-1676015614786] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-10 07:56:36,375 INFO [Listener at localhost/46793] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-10 07:56:36,511 INFO [Listener at localhost/46793] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-10 07:56:36,615 INFO [Listener at localhost/46793] hbase.HBaseTestingUtility(1293): Minicluster is down